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Preface 



These are the proceedings of the conference Interesting Algebraic Varieties 
Arising in Algebraic Transformation Groups Theory that was held at The 
Erwin Schrodinger International Institute for Mathematical Physics, Vienna, 
Austria, from October 22 through October 26, 2001. 

The conference was made possible through interest and financial and orga- 
nizational support of The Erwin Schrodinger International Institute for Ma- 
thematical Physics, Vienna, Austria. On behalf of all participants I thank this 
institution and especially P. W. Michor, one of its Directors, for this interest 
and support. 

It is an empirical fact that many interesting and important algebraic vari- 
eties are intimately related to algebraic transformation groups. To name only 
some, the examples are affine and projective spaces; quadrics; grassmanni- 
ans, flag and, more generally, spherical (in particular toric) varieties; Schu- 
bert varieties; nilpotent varieties; determinantal varieties, Severi, Scorza and, 
more generally, highest vector (HV-) varieties; group varieties; generic tori 
in algebraic groups; commuting varieties; categorical quotients of Geometric 
Invariant Theory and the related moduli varieties of curves, vector bundles, 
abelian varieties etc.; simple singularities realized as that of the corresponding 
categorical quotients and nilpotent orbit closures. The idea of the conference 
was to trace the new evidences of this relation. 

For various reasons several talks given during the conference do not appear 
in these proceedings. Below a complete listing of all talks given is presented for 
the information about the conference. The talks which do appear are generally 
expanded and/or modified versions of those given during the conference. 
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Factoriality Of Certain Hypersurfaces Of 
With Ordinary Double Points 



Giro Ciliberto and Vincenzo Di Gennaro 

Universita di Roma Tor Vergata, Dipartimento di Matematica, 

Via della Ricerca Scientifica, 00133 Roma, Italia. 

cilibertSaxp .mat .uniroma2 . it, digennar@axp.mat .uniroma2 . it 

Abstract. Let V C be a reduced and irreducible hypersurface of degree fc > 3, 
whose singular locus consists of 5 ordinary double points. In this paper we prove 
that if (5 < fc/2, or the nodes of V are a set-theoretic intersection of hypersurfaces of 
degree n < k/2 and 5 < {k — 2n){k — l)^/fc, then any projective surface contained 
in V is a complete intersection on V. In particular V is Q-factorial. We give more 
precise results for smooth surfaces contained in V. 



Gontinuing the work of M. Noether on the curves contained on a gen- 
eral surface in projective space, in 1906 F. Severi discovered that any surface 
contained in a smooth hypersurface of is a complete intersection. Severi’s 
original proof of this famous theorem [S] is based on an arithmetic argument 
using the Valentiner-Noether bound for the genus of a curve contained in 
a space surface [H] . 

Refining this argument and using some results on the Halphen gaps [E], 
in this paper we extend Severi’s theorem to hypersurfaces of P'^ with few 
ordinary double points. More precisely, we will prove the following: 

Theorem. Let V C be a redueed and irreducible hypersurface of degree 
k > 3. Assume that the singular locus of V consists of 6 ordinary double 
points, and that at least one of the following properties holds: 

(A) 5 < k/2; 

(B) the nodes of V are a set-theoretic intersection of hypersurfaces of de- 
gree n < k/2, and 5 < {k — 2n){k — l)^/fc. 

Then any projective surface contained in V is a complete intersection on 
V . In particular V is Q-factorial. 

2000 Mathematics Subject Classification. Primary 14C22, 14J17, 14J70, 14M10; Sec- 
ondary 14M05, 14H50. 

Key words and phrases. Projective hypersurface, ordinary double point, complete 
intersection, space curve, Noether-Halphen theory, Weil divisor class group. 
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Notice that, when k > 72, the saturated ideal of a set of S < {k — 1)^ 
points in general position in is generated by polynomials of degree < kjA 
[GM], 

The Theorem provides (as far as we know) new examples of Q-factorial 
projective varieties [MP]. In principle, the method we use could prove that, 
more generally, hypersurfaces in P'^ with few isolated singularities are, under 
suitable hypotheses, Q-factorial. 

When studying smooth surfaces in V, we have a more precise result, i.e. 
the following proposition: 

Proposition. Let V C be a reduced and irreducible hypersurface of degree 
k > 3. Assume that the singular locus ofV consists of 5 ordinary double points. 
If 5 < {k—lY then any smooth projective surface contained inV is a complete 
intersection on V. The same is true if {k — 1)^ < S < 2{k — l)(/c — 2) and V 
does not contain any plane, and if S = 2{k— f){k — 2) and V does not contain 
either a plane or a quadric. 

Moreover, if {k — 1)^ < S < 2{k — l)(fc — 2) and V contains some plane it, 
then IT is unique, V does not contain any quadric {except when k = 3), and 
the subgroup Clo(P) of the Weil divisor class group ofV generated by smooth 
surfaces is freely generated by tt and by the general hyperplane section of V. 
If S = 2{k — 1)(A: — 2) and V contains some quadric q, then q is irreducible 
and unique {except when k = 4), and Clo(P) is freely generated by q and by 
the general hyperplane section of V. 

One may hope that Proposition holds true for any surface contained in V, 
but we have not been able to prove this. Neither we do know whether Clo(P) 
is equal to the full Weil divisor class group of V. 

Notice also that the Sever! variety of hypersurfaces of degree k in P"* with 
{k — 1)^ nodes, has two irreducible components, corresponding to the family 
of hypersurfaces whose nodes are in general position, and to the family of 
hypersurfaces containing a plane. 

In order to prove our claims, we need the following lemma: 

Lemma. With the same notation as in the Theorem, let X C V be any 
reduced and irreducible projective surface. Let S CV be the surface residual to 
X in the complete intersection of V with a general hypersurface of degree 0 
containing X. Then S is irreducible and smooth away from the intersection 
of the singular locus Sing(P) ofV with the singular locus of X. The germ of 
S at any point p G S' n Sing(P) is isomorphic to the germ at p of a surface 
consisting of a finite number i = i{p) of planes contained in the same ruling 
of a 3-dimensional quadric cone with vertex at p. 

Proof of Lemma. Using a similar argument as in [S] one sees that S is smooth 
away from the intersection of Sing(U) with the singular locus of X. 

Let 7T : U ^ U be the blow-up of V along Sing(U). Since V has only 
ordinary double points, then V is smooth and its exceptional divisors Ei, 
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i = 1, . . . , i5, are smooth quadric surfaces. The strict transform X of X meets 
each Ei in a curve of type (ai,bi), with Ui > bi > 0. Let Hy be the general 
hyperplane section of V. When n ^ 0, the general surface E of the linear 
system | mr*{Hv) — X — X)i=i I is smooth and irreducible, and meets Ei 
in a curve of type (0, Oi — bi). This proves Lemma because 7 t*(T') = S. Q.e.d. 
for Lemma. □ 

Now we are going to prove Theorem with the hypothesis (A). 

Let X C IL be a reduced and irreducible surface. To prove that X is 
a complete intersection, it suffices to prove that the surface S, residual to X 
in the complete intersection of V with a hypersurface of degree ^ 0 containing 
X, is a complete intersection. 

This said, for any integer i > I, denote by the number of points of 
S n Sing(t^) with multiplicity i for S (compare with the previous Lemma). 
We have 

+00 

= 6{S), 

where 6{S) denotes the cardinality of the set S n Sing(y). Let / : A ^ P"* be 
the normalization of S. Notice that Lemma implies that E is smooth. Denote 
by A// the normal bundle of the map /. By the double point formula we 
deduce 

+CO y 

C 2 (A//(-fc)) = (f + dk{k - 4) - k{2g - 2) - 2[^ 

where d ^ 0 and g are the degree and the sectional genus of S. On the other 
hand, taking into account Lemma, a local computation proves that each point 
of S' n Sing(P) with multiplicity i for S has the same multiplicity i in the 
0-cycle representing C 2 {N f{—k)), i.e. C 2 {M f{—k)) = Summing up 

we obtain X£T = d"^ + dk{k — 4) — k{2g — 2), i.e. 

+ 00 

i^mi = 2k{G — g) + v(k — v)(k — 1). (1) 

i=l 

In the formula (1), v is defined by writing d = pk — v,Q<v<k — 1, and 

G = G{d, k) = d^/2k + d{k - 4)/2 - y{k - v){k - 1) /{2k) + 1 

denotes the Noether-Halphen bound of g in (see [S], [H]). 

Now fix a point p G S H Sing(P) with multiplicity i > 1. Let Hp be the 
general hyperplane through p, and denote by G the reduced subscheme of 
the scheme-theoretic intersection S n iJp. The description of the germ of S at 
p given in Lemma implies that the geometric genus Pg{C) of the irreducible 
curve G is equal to g. Then we have 

G-g>pa{C)-pg{C), 
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where Pa{C) denotes the arithmetic genus of C. Using Lemma again, we see 
that Pa{C) — Pg{C) is equal to the difference between the arithmetic genus 
of the reduced curve consisting of i lines lying in a quadric cone in and 
the arithmetic genus of the curve consisting of i mutually skew lines. This 
difference is i‘^/4 when i is even, and (i^ — l)/4 otherwise. And so we deduce 

G-3>(*2-1)/4. (2) 

Let h be the maximal integer i > 1 such that nii yf 0 (put h = 1 if nii = 0 
for any i). Taking into account that using (1) and (2) with 

i = h, we obtain 

iy{k - iy){k - 1) < h‘^{6 - k/2) + k/2. 

By our hypothesis (A) we deduce h'^ < k/{k — 26). Hence 

+00 

i’^nii < Sk < {k — 1)^. (3) 

i=l 

By (1) it follows that ^{k — iy){k — 1) < {k — 1)^ from which we get ly = 0. 
If g < G then, by [E, IV. 2 and VI. 3], we have G — g > k — 2. By (1) and (3) 
we obtain 2k{k — 2) < {k — 1)^, which is not possible because fc > 3. Hence 
we have g = G. By [H] it follows that the general hyperplane section of S is 
a complete intersection on the general hyperplane section of V, and so also S 
is on U. This concludes the proof of Theorem with the hypothesis (A). 

Next we are going to prove Theorem with the hypothesis (B). 

To this purpose, fix an irreducible hypersurface F C of degree n < k/2, 
passing through Sing(U), and such that TYlU and FnS are irreducible. Such 
a hypersurface F exists by the hypothesis (B) . Denote by D the reduced sub- 
scheme of the scheme-theoretic intersection F C\ S. Using the same argument 
as in the proof of (2), we have 



+00 

Pa{D) - pg{D) > - l)/4, 

i=l 

where Pg{D) (resp. Pa{D)) denotes the geometric genus (resp. the arithmetic 
genus) of D. Notice that Pg{D) is equal to the geometric genus of the section 
of S with a general hypersurface of degree n, and so 

Pg{D) = [ri^d + n(2g - 2 - d) + 2]/2. 

On the other hand, since by construction D is an irreducible curve in P'^ 
verifying a flag condition of type (rid,nk,n) [CCD], we also have (assume 
k > n — 1) 

Pa{F>) < G{nd, nk, n) := nd^ /2nk + nd{n -I- fc — 5)/2 -|- p -I- 1, 
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where p is defined as follows. Write 

nv = uk + V, 0 < V < k — 1. 

Put A = k{n— l){n + k), B = {n— l)k, C = nk—l, D = nk{n— l){n + k— 1) 
and E = nk{n + k — 2). Then we have 

p = {Av^ + 2Buv + Cv^ — Du — Ev) /2nk 

(see [CCD, p.l32, Proof of the hound of Theorem] for the definition of 
G{nd,nk,n), and do not use the explicit definition given in [CCD, p.l20] 
because there is a misprint there). Summing up we obtain the following esti- 
mate 



+ 00 

2k{G — g) + v(k — v)(k — 1) > —2kp/n + 2fc[^^ rriiijf — l)/4]/n. (4) 

i=l 

Now we notice that 

2kp/n < 0. (5) 

In fact, a direct computation proves that, in the u v plane, the locus p = 0 is 
a real ellipse E, and the vertices of the rectangle 

0<u<n—l, 0<v<k — l, 

to which u and v belong, lie either on E or in its internal region. Taking into 
account our hypothesis (B), from (1), (4) and (5) we obtain 

+ 00 

< kS{S) /{k — 2n) < {k — 1)^. 

As from (3), we deduce that S' is a complete intersection on V. This concludes 
the proof of Theorem with the hypothesis (B). Q.e.d. for Theorem. □ 



Now we are going to prove Proposition. We keep all the notation intro- 
duced in the proof of Theorem. 

We begin by examining the case 5 < (/c — 1)^. To this purpose, by the 
Lemma, it suffices to prove that any smooth surface S of degree d ^ 0, 
contained in P is a complete intersection on V. Since S is smooth, then 
formula (1) becomes 



S{S) = 2k{G-g) + n{k-n){k-l). (6) 

By our numerical hypotheses on 6, it follows that v{k — v){k — 1) < {k — 1)^, 
and so, as from (3), we deduce that S is a complete intersection on V. 

Now we examine the case {k— 1)^ < S < 2{k — l)(fc — 2) (hence k > A). Let 
S' C P be a smooth and irreducible surface which is not a complete intersection 
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of degree d 0. By using (6) we get v{k — v){k — 1) < 2{k — l)(fc — 2). If 
v{k — v){k — 1) < {k — 1)^ then i/ = 0 and so G — g>k — 2 [E, loc. cit.]. By 
(6) we get 2k{k — 2) < 2{k— l)(/c — 2), which is not possible. Hence {k — 1)^ < 
i/{k — v){k — 1) < 2(k — l){k — 2), from which we obtain iy{k — i^) < 2(k — 2), 
with 1 < V < k — Therefore either v=loxv=k — 1. By the classification 
of the curves with maximal genus [H], it follows that if V does not contain any 
plane then g < G. By [E, IV. 2, IV. 3, VI. 2 and VI. 4] we deduce G — g > k — 3 
and then by (6) we get 2k{k — 3) + {k — I)^ < 2(fc — I)(fc — 2), which is not 
possible. 

In order to prove the assertion concerning the group Clo(E) in the range 
(A: — 1)^ < d < 2{k — l){k — 2), suppose that V contains a plane tt. The 
nodes of V which belong to tt are the complete intersection of two plane 
curves of tt of degree k — 1. Therefore, if V contains another plane cr, the 
intersection of tt with a contains at most k — 1 nodes of V. It follows that 
2{k — 1)^ — (k — 1) < 2{k — l)(fc — 2), which is not possible. Hence tt is unique. 
Since tt is unique, the argument above shows also that Clo(E) is generated 
by TT and by the general hyperplane section Hy of V. Moreover tt and Hy 
freely generate Clo(E), otherwise rriTT would be a complete intersection on V, 
for some m > 2. This is in contrast to the fact that the singular locus of V 
is finite. If V also contains a quadric g, then q is irreducible and contains all 
the nodes of V (see below) . It follows that the nodes contained in tt belong to 
a conic of tt. This is impossible, except when k = 3. 

Now we analyze the case 6 = 2{k—l){k—2). Let S' C E be a smooth surface 
of degree d ^ 0, which is not a complete intersection. As before, we see that if 
2k(G— g) + iy(k — ir)(k— 1) < 2(fc— l)(fc — 2) then V contains a plane. Then if V 
does not contain any plane, we have 2fc(G—(;)+zz(fc—iz)(fc—l) = 2(fc— l)(fc— 2). 
It follows that v{k — v){k — 1) < 2{k — l)(fc — 2), i.e. v{k — v) < 2{k — 2). 
As before, one sees that the strict inequality v{k — v) < 2{k — 2) leads to 
a contradiction. Hence v{k — v) = 2{k — 2) and so iz = 2 or iz = /c — 2, and 
g = G. By [H] it follows that the general hyperplane section of V contains 
a conic, which lifts to a quadric on V. 

As in the previous range, one sees that, when S = 2{k — l)(fc — 2), if V 
contains some plane tt, then tt is unique, V does not contain any quadric 
(except when k = 3), and the subgroup Clo(E) is freely generated by tt and 
by the general hyperplane section of V. 

Finally suppose that 6 = 2{k — l){k — 2) and that V contains a quadric q 
(we may assume fc > 4). Then q is irreducible. Let (l,g) be the homogeneous 
ideal of q in P'^, with deg(/) = 1 and deg((/) = 2. If / = 0 is the equation 
defining V, then we have f = Al + Bg, for suitable polynomials A and B of 
degree k—1 and k — 2. The zero-dimensional scheme Z defined by I, g, A 
and B has degree 6 and its points are nodes of V. Since the nodes of V are 
ordinary double points, then Z is reduced and equal to the set of nodes of 
V. It follows that q contains all the nodes of V and that the nodes are the 
complete intersection of the hypersurfaces defined by I, g, A and B. Hence q 
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is unique, except when fc = 4. At this point, in a similar way as in the case 
that V contains a plane, one proves that Clo(V^) is freely generated by q and 
by the general hyperplane section of V. 

This concludes the proof of Proposition. Q.e.d. for Proposition. □ 



Acknowledgement. The first author wishes to thank A. Corti for having pointed out 
the problem of proving that hypersurfaces in with few nodes, are Q-factorial. 
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Abstract. We prove that for certain projective varieties (e.g. smooth complete in- 
tersections in projective space), there are only finitely many components of the 
Hilbert scheme parametrizing irreducible, smooth, projective subvarieties of low 
codimension and not of general type. We give similar results concerning subvari- 
eties with globally generated tangent bundle. 



Introduction 

In [6] Schneider proved that, when n > (m + 2)/2, there are only finitely 
many components of the Hilbert scheme parametrizing smooth subvarieties of 
dimension n in P™ not of general type. De Gataldo [3] extended Schneider’s 
result to the case of smooth quadrics of dimension m. In the present article 
we offer a further extension, which we now will state. 

Let V be an irreducible, smooth, projective variety of dimension m, over C. 
Let 5 be a set of projective subvarieties of V. We will say that S is hounded 
if there is a closed immersion V C P’’ such that 

sup{deg(V) : A G 5} < -boo. 

This means that the varieties in S belong to finitely many components of the 
Hilbert scheme. In particular, this definition does not depend on the closed 
immersion. 

Refining the proof of Schneider [6], in this paper we will prove the following: 

Theorem. Let V CP'^ be an irreducible, smooth, projective variety of dimen- 
sion m. Let n > {m-\-2)/2 he an integer and put k = m—n. For i G {1, fc, fc+1}, 
assume that any algebraic class in iL^*(V,C) is a multiple of Hy, where Hy 

2000 Mathematics Subject Classification. Primary 14C05, 14M07, 14M10; Secondary 
14J99, 14K99. 
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is the hyperplane section of V. Then the set of irreducible, smooth, projective, 
n-dimensional subvarieties of V not of general type is bounded. 

By the Lefschetz Hyperplane Theorem and Noether-Lefschetz Theorem 
[1, Corollary, p. 179] we obtain the following 

Corollary. Let C C P’' &e an irreducible, smooth, complete intersection of di- 
mension m. Let n > (m+2)/2 be an integer. Only when n = (m+2)/2, assume 
that V is general in the sense of Noether-Lefschetz, with yf 0 for 

some a < m/2. Then the set of irreducible, smooth, projective, n-dimensional 
subvarieties of V not of general type is bounded. 

Notice that for any smooth hypersurface V C of dimension m = 

2(n — 1) > 4 and degree > 3, one has yf 0 [5, p. 173]. 

Next we turn to the cases n = m/2 and n = (m + l)/2 and we prove some 
partial results concerning abelian subvarieties (see Corollary 1 and 2 below), 
and subvarieties with generated tangent bundle (Corollary 3). Notice that all 
these subvarieties are not of general type, because their first Chern class is 
effective. It turns out that, in certain cases, the set of such subvarieties is 
empty (compare with [7] and [8]). 



Notation 

Let Y C P*" be any smooth, irreducible, projective variety over C. We will 
denote by Hy the hyperplane section of Y, by Ty the tangent bundle, and by 
Ky a canonical divisor. If S is any sheaf on Y we denote by Ci{S) its Chern 
classes and by Si{£) its Segre classes. If Z C V is a subvariety, we denote by 
Nz,y the normal sheaf of Z in F. 

If 5 is a set and / : 5 — > N is a numerical function, we say that a function 
g : S is 0{f), and we write g = 0{f), if ]5(^)1 < Cf{f) for all f G S, 
where C is a constant. 



The Proof Of Theorem 

We begin by proving the Theorem stated in the Introduction. To this purpose, 
let X C T be a smooth subvariety of dimension n, of degree d. Taking into 
account our hypothesis on the cohomology of the ambient variety V, and using 
a Barth-Lefschetz type of argument (see [2, Theorem 1.1 and proof]), one has 

Kx = eHx 



in H‘^{X,C), for some rational number e. Notice that if X is not of general 
type then e < 0. 
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Now let q and 7 be rational numbers such that Ky = qHy in C) 

and Tvi'j) is globally generated. Then also Nx,v{j) is. Since 

ciiNxyi'f)) = {k-f + e- q)Hx, (1) 

by [4] we deduce 0 < kj + e — q < kj — q. Notice that taking 7 7^ 0 we may 
assume 1 < kj + e — q. Therefore we get 

1 < k"f + e — q = 0(1). (2) 

We need the following lemma. We will prove it below. 

Lemma. With the same assumptions as before, for any i = 0, . . . , k one has 
(7i?x)"-*c,(iVx.y)ci(fVx,y(7))”-" = 0{d). 

Using Lemma for i = k, (1) and the self-intersection formula 
Ck{Nx,v) = {d/t)Hx, 

{t = degree of V) we obtain 

(d/t)(fc7 + e-(7)”-'^i?x = 0(d). 

By (2) it follows that 

(f/t = 0{d), 

whence the boundedness for d. This concludes the proof of Theorem. Q.e.d. 
for Theorem. □ 

Now we are going to prove Lemma. We argue by induction on i, the case 
i = 0 being true by (1) and (2). Assume then 1 < i < fc. From the formula 

c^{Nx,vh)) = (*I^)(7i^x)*-'^c^(iVx.y), 

h=0 ' 

intersecting with {jHx)^~'^ci{Nx,v{l))^~^ and using induction, we get 

(7iLx)"-*c,(iVx,y)ci(7Vx,x(7))”-" 

= (7i^x)"-*Ci(iVx,y(7))ci(iVx.y(7))”-" + 0{d). 

Hence in order to prove Lemma, it suffices to prove that 

{jHx)'^-^c,{Nx,vh))ci{Nx,vh)r-'' = 0{d). (3) 

To this purpose, first notice that since Nx,v{j) is globally generated then by 
[4] we have 



0 < (7i?x)'=-*c,(iVx.y(7))ci(iVx,y(7))”-^ 



(4) 
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On the other hand one has (use [4] and [6, proof of Proposition]) 

c^{NxAl))cl{NxAl)T~^ < ANxAi)T, 

from which, by (1) and (2), we deduce 

{lHxA^ANx,vA)ci{NxAl)r~" 

= ANxAi)h"~\A + e - qr~AA^ 

= 7'=-*(fc7 + e - qy->^ANx,vA){kl + e - qA^A" 

= + e - qy-'^ANxAl))ANx,v{l)T-^ 

< Aykj + e - qy-'^ANxAlA 

= AHk-f + e- qA^-^Hl = 0{d). 

Taking into account (4), it follows (3). This concludes the proof of Lemma. 
Q.e.d. for Lemma. □ 

Some Partial Results 

In the Cases n = m/2 and n = (m + l)/2 

Now we are going to state some partial results in the cases n = m/2 and 
n = (m + 1) /2. We need the following 

Proposition. Let V C be an irreducible, smooth, projective variety of 
dimension m and degree t. Let n be an integer with n < m < 2n and put 
k = m — n. Assume that at least one of the following properties holds. 

(A) any algebraic cycle in is a multiple of Hy, where Hy is the 

hyperplane section of V; 

(B) k is even and C) = C for any i = 1, . . . ,k — 1. 

Let X C V be a smooth subvariety of dimension n and degree d. Denote by 
Ci{Tv) the Chern classes ofV and by Si{Tx) the Segre classes of X. Then we 
have 



dVt < [Y/ sAx) ■ cuATv)\x] ■ (5) 

i=0 

Proof. Let L C P’’ be a general linear subspace of dimension r — n + k and 
put X' = X n L and V = V f] L. We have dim(A') = k and dim(W) = 2k. 
From the normal bundle sequence 

O^Tx' ^ Tv ® Ox' Nx',v 0 



we obtain 



Ck{Nx>,v>) = (Y • Ck-i(Tv)\x] • A 



(6) 
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In the hypotheses (A), using the self-intersection formula we get Ck{Nx',v) 
= cP /t and so, in this case, we deduce (5) as an equality. 

In the hypotheses (B), the Lefschetz Hyperplane Theorem and the Hodge- 
Riemann bilinear relations imply that the intersection form on is 

positive definite. Hence we have 

(X' - > 0. 

Using the self-intersection formula we get 

Ck{Nx',v) = {X'f > d^/t 

from which, taking into account (6), we obtain (5). Q.e.d. for Proposition. □ 

As a consequence of the previous proposition, we obtain the following 
boundedness result for abelian subvarieties of a complete intersection. 

Corollary 1. Let U C P’’ &e an irreducible, smooth, complete intersection of 
dimension m. Let n> m/2 be an integer. When n = m/2 and n is odd, assume 
that V is general in the sense of Noether-Lefschetz, with 0 for 

some a < mj2 {e.g., any general hypersurface of even dimension m > 4 and 
degree > 3). Denote by t the degree of V and let ij be the integer such that 
Cn-m{Tv) = Let X CV be an abelian subvariety of dimension n and 

degree d. Then we have 

d < r]t. (7) 

The equality occurs except when n = m/2 and n is even. 

Proof. By the Lefschetz Hyperplane Theorem and by the Noether-Lefschetz 
Theorem [1], we may apply the previous proposition to V and so, taking into 
account that all the Chern (and Segre) classes of an abelian variety vanish in 
codimension > 0, we get (7) from (5). Q.e.d. for Corollary 1. □ 

By making formula (7) explicit, in the case U is a hypersurface we deduce 
a more precise result. 

Corollary 2. Let V C be a smooth hypersurface of dimension m = 

2n > 6, and degree t. When n is odd, assume that V is general in the sense of 
Noether-Lefschetz, with yf 0 for some a < m/2 {e.g., any general 

hypersurface of even dimension m > 4 and degree > 3). Let X C V be an 
abelian subvariety of V of dimension n and degree d. Then 

nl{2n + 2) < d < ^ (— = f{n, f). 

Remark. In particular, when f{n,t) < nl{2n + 2), there is no abelian sub- 
variety of V of dimension n. This is the case when n is even and t <iC n (e.g., 
t < 3 for n = 4, t < 5 for n = 6, t < 6 for n = 8, etc.), and when n is odd and 
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Proof of Corollary 2. With the same notation as in Corollary 1, when V is 
a hypersurface then rjt = f(n,t)- On the other hand, by the Riemann-Roch 
Theorem, we have d = n\hP{X, Ox{^)) and, by a theorem of Van de Ven [7], 
if n > 3, then h^{X,Ox{^)) >2n + 2. Q.e.d. for Corollary 2. □ 

We conclude with the following result concerning subvarieties with globally 
generated tangent bundle. 

Corollary 3. Let V C be a smooth hypersurface of dimension m, of 

degree t > m + 2. Let n > m/2 be an integer such that k = m — n is odd. 
When n = m/2, assume that V is general in the sense of Noether-Lefschetz. 
Then there is no smooth subvariety ofV of dimension n and globally generated 
tangent bundle. 

Proof. Put Ci{Tv) = rjiHy, iji S Z. Since t>m + 2, then (— > 0 for any 
i = 0,. . . ,k. Now let X C P be a subvariety of dimension n, degree d, and 
globally generated tangent bundle. From [4] we have Si{Tx) • Ck-i{Tv)\x < 0 
for any i = 0, . . . ,k. From (5) we deduce d < 0, which is not possible. Q.e.d. 
for Corollary 3. □ 
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Abstract. Given a representation p : G ^ GL(A) of a semisimple group G, we 
discuss the normality or non normality of the cone over p(G) using the wonderful 
compactification of the adjoint quotient of G and its projective normality [K]. These 
methods are then used to discuss the normality or non normality of certain other 
orbit closures including determinantal varieties. 



1 Introduction 

Given a finite dimensional representation p : G GL(G), where we assume 
that G is an algebraic group defined over an algebraically closed field of cha- 
racteristic 0 and that p is rational, a natural object to consider is the cone 
Zv over p(G), i.e.,the closure of the linear transformations in End(R) which 
are multiples of some p{g) for g & G.li is easy to see that Zy is a semigroup 
and one may ask about geometric properties of this semigroup. In this paper 
we are going to analyze the normality of Zy under the assumption that G 
is semisimple and that V is an highest weight module. In particular, we are 
going to perform this discussion in the case in which V is irreducible. 

It turns out that in this case, Zy is almost never normal. Indeed, we prove 
that it is normal if and only if R is a minusculrepresentation (for the definition 
see Section 3). On the other hand we are able in all cases to exhibit the 
normalization of Zy, which turns out to be of the form Z\y for “the largest” 
G-module having the same highest weight as V, that is W is the sum of all 
irreducible modules whose highest weight is less than or equal to that of V in 
the dominant ordering. After this is achieved, we make the observation that 
our methods can be used to analyze a much larger class of orbit closures which 
include, among others, various varieties of matrices satisfying rank conditions, 
in particular determinantal varieties. Thus we slightly generalize our methods 
to treat this case as well. 

We now briefly explain how our results are obtained. The main observation 
is that the coordinate ring of Zy is also the homogeneous coordinate ring of the 
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associated projective variety. This projective variety turns out to be the image 
under a suitable morphism of a certain completion of a homogeneous space (in 
the case of the semigroups over G, this is the wonderful compactification of G 
introduced and studied in [DCP]). Thus results about such compactifications 
can be used. In particular we crucially use their projective normality recently 
proved by Kannan in [K], not only directly, but also as the main idea behind 
our arguments. 

To finish I would like to stress that many of our results are contained or 
implicit in the work of others. Affine semigroups for semisimple or reductive 
groups have been considered by various authors (see for example [Rel], [Re2], 
[RP], [Ri], [V]). Some of the questions considered below have been addressed 
in [F] and results closely related to those of this paper have been obtained 
in [T]. In particular a great deal of the content of our Theorem 3.1 can be 
obtained using [V] together with [K]. Under the normality assumption, the 
property of having rational singularities has been proved in similar terms in 
[Ri]. Nonetheless, we have decided to give complete proofs, including those of 
such known facts as the projective normality result of Kannan. 

Our paper is divided as follows. After a section giving our notations, we 
discuss the normality of semigroups in Section 3. In Section 4 the generali- 
zation to other orbit closures is explained. In order to obtain this result, we 
need to slightly generalize the theory of wonderful completions of an adjoint 
group. Since the proofs of many assertions are essentially identical to those of 
the corresponding assertions in the case of group compactifications, they are 
sometimes omitted. Finally in the last section we discuss various examples. 



2 Notation 

Let k denote an algebraically closed field of characteristic 0. Let G be a 
semisimple simply connected algebraic group over k. Choose a maximal torus 
T and a Borel subgroup B Z) T in G, and let W = N{T)/T be the Weyl group 
of (G,T). 

Consider the character group P := X{T) of T, and let Z\ C P denote the 
roots of (G, T) with Z\+ the positive roots relative to B. Similarly consider the 
dual lattice P, and the set of coroots A with positive coroots A+ . Set P+ equal 
to the semigroup of dominant weights, the weights A such that (A, d) > 0 for 
each positive coroot a. Here ( , ) is the canonical kF-invariant inner product 
on P 0 R. P+ is a fundamental domain for the action of the Weyl group W 
on P. 

Let us order P by setting A>/iifA — /xisa positive linear combination 
of positive roots. This order is called the dominant order. 

Recall that the set of isomorphism classes of finite dimensional irreducible 
representations of G is in bijection with P+, the bijection being defined as 
follows. Any such representation contains a unique line preserved by B called 
the highest weight line. Given a non zero vector v in such a line, then T acts on 




Normality and Non Normality Of Certain Semigroups and Orbit Closures 



17 



V by multiplication by a character A G . The “unique” (up to isomorphism) 
irreducible module corresponding to A will be denoted by V\. 

P can be identified with the Picard group oiG/B. We fix this identification 
in such a way that, if A G P+, the line bundle L\ corresponding to A is such 
that 

H°{G/B,Cx) = Vx. 

Let us recall a few facts about the weight structure of V\. We say that a weight 
fj, € P appears in a representation V if there is a non zero T eigenvector w G P 
of weight /r. One has: 

(1) /i appears in V if and only if ic/i does for every w G W. 

(2) If /r appears in V\, then /x < A. 

(3) /i appears in V\ if and only if the unique dominant weight of the form 
v = wfjL satisfies v < X. 

We shall say that a finite dimensional G-module U has highest weight 
A G P+, if it has a non zero vector of weight A and each weight /x which 
appears in U satisfies /x < A. 

Recall that a dominant weight A is called minuscule if it satisfies one of 
the following 

(1) (A, d) < 1 for all positive coroots a. 

(2) If /X is dominant and fJ, < X, then /x = A. 

(3) A weight appears in Vx if and only if it is in the IP-orbit of A. 

Given now A G P+, we define its saturation as the set 

G -P+ I M < •^}- 

It is well known that A is minuscule if and only if A(A) = {A}. 



3 Some Semigroups 

Given a G-module V, denote by / G End(P) the identity map. Gonsider the 
morphism 7 : G x Gm End(P) defined by 7 ((g, z)) = gzl = zgl. The image 
of this morphism is the set of G translates of the homotheties. 

Notice that clearly the image of 7 lies in GL(E) and as a morphism 

-r.GxGm^ GL{V), 

7 is a group homomorphism. Furthermore 7 (G x Gm) is stable under the 
action of G x G by left and right multiplication. 

We set Zy equal to the closure of y(G x Gm) in End(E). Note that, by 
continuity, Zy is closed under composition, i.e.,it is a semigroup, and it is 
stable under the action of G x G by left and right multiplication. The main 
goal of this paper will be to discuss the normality of these semigroups for 
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certain representations V of G. First some notation. Fix a dominant weight 
A G P+ and let Af(A) be its saturation. Define IFa = 

We set 

Enid 2 a := Z]Y^. 

We can now state: 

Theorem 3.1. 1) Za is a normal variety with rational singularities. 

2) IfV is a G-module of highest weight X, then Z\ is the normalization of 
Zy , and it is equal to Zy if and only ifW\ is a suhrepresentation ofV. 

In particular Z\ is the normalization of Z\ and it is equal to Z\ if and only 
if A is minuscule. 

The proof is an application of some of the results in [DCP], so before giving 
it, let us recall these facts. 

In [DCP] one studies the following variety. Consider wi, . . . , w„, the fun- 
damental weights for (G, T). Let pi G P(End(V^J) be the point repre- 
senting the line spanned by the identity. Define X to be the closure in 
P(End(VljJ) X • • • X P(End(Kj„)) of the orbit G{pi, . . . ,Pn)- X is called the 
wonderful compactification of the adjoint group G = GjZiG), and it has a 
number of very nice properties. Here we shall need some of them. 

First of all X is a smooth G x G- variety with open orbit G(pi, . . . ,p«), the 
complement of which is a divisor with normal crossings and smooth irreducible 
components Di, . . . , D„. Given a subset I C {1, . . . , n}, the smooth subvariety 
Dj := is the closure of the G x G-orbit Oi = Dj — Ujd/Dj {Dq = X) 

and each G x G-orbit equals one of the Oj. In particular X contains a unique 
closed G X G-orbit which can be seen to be isomorphic to G/B x G/B. 

One knows that the Picard group of G/B x G/B can be identified with 
P X P, and one has that the homomorphism Pic(X) ^ Pic(G/H x G/B) is an 
injection whose image is the lattice consisting of pairs of the form (A, —wo{X)), 
Wo being the longest element in W. Thus Pic(X) can be identified with P. 
Under this identification, the classes of the 0{Di) correspond to the simple 
roots ai. 

Furthermore take A G P+ and U a G-module of highest weight A. 

Consider the point p G P(End(C/)) representing the line spanned by the 
identity. Set X{U) = Gp. Then the obvious map G(pi, . . . ,p„) ^ X{U) given 
hy g{pi, ... ,pn) ^ gp extends to a morphism 

(f: X ^ X{U) -> P(End(C/)) 

(in fact if A is regular 0 gives an isomorphism of X onto X{U)). 

Furthermore under the identification of Pic(X) with P, A corresponds to 
the class of 0*(G(1)), 0{1) being the tautological line bundle on P(End(C/)). 

The above discussion obviously applies to both Ua and W\. Furthermore 
it is clear that Z\ is nothing else than the affine cone over X{V\), while Z\ is 
the affine cone over X{W\). Thus the coordinate rings of Z\ and Z\ can be 
identified with graded G x G stable subrings of the ring 
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being the line bundle on X corresponding to fx. 

Let us take now for each simple root the unique (up to a scalar) G x G 
invariant section of H^{X, LqJ, whose set of zeroes is the divisor Di. We can 
filter the ring 

i? := 0^epi/O(X, L^) 

by the order of vanishing on the D[s. We get a filtration R = Rq D Ri D 
• • • D Rm A , where 

R,= 

hi~\ \-hn—i 

One then easily gets from [DCP] 

Proposition 3.2. The associated graded ring GrR = (BiRi/ Ri+i, is isomor- 
phic to the polynomial ring , Xn], where Xi is the class of Si in R 1 /R 2 

and 

C = (B\epH^{G/B x G / B , C{^x-wo{X)]) ■, 
being the line bundle on G j BxG j B corresponding to (A, — ruo(A)) € 

P X P. 

Proof. Fix X G P. We have already seen that if we restrict the line bundle L\ 
to G/B X G/B, we get the line bundle L(a,-u)o(a))- ^^so if we consider the 
restriction map 

H\X,Lx) ^ H\G/B X G/B,£(a,_™„(a))), 

we have that this is surjective with kernel i?i(A) = i?i n H^{X, L\). 

Given two sequences h = {hi , . . . , h„} and k = {ki , . . . , fc„}, we shall say 
that k>hiiki>hi for each i = 1, ... ,n. If we now fix such a sequence h, 
we set Rh{\) equal to the image of the map 

H\X,Lx-^h,c,) ^ H\X,Lx) 

given by multiplication by Then by [DCP], we know that this map 

induces an isomorphism of G x G-modules, 

V’^(A) : Rh{X)l Y, Rk{X) ^ H\X, La-e ^ h,ai) ^ 

k>h 

= H°{G/B X G/B,C(x-y: hiai,-wo{\-Y: hiOi)))- 
Since clearly 

Gri? = (B\eP,hRhfX)/ Rk(X), 

k>h 

we get the required isomorphism 

if : GrR C[xi, . . . , Xn] 

by setting if{a) = ifh{X){a)x^^ ' ' ' x’ff for a G Rh{X)/Y,k>h^h.{X). □ 
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As an application of this proposition, we have 
Proposition 3.3. Let A G P+. Then the ring 

A:= ®uH\X, L„a) 

is normal with rational singularities. 

Proof. By a result of Kempf and Ramanathan [KR, Theorem 2] , the ring 

®(\,ij.)GPxpH^{G/B X G/B,C(^x,ti)) 

is normal with rational singularities. Now if we let T x T act on this ring by 
(ti,t 2 )s = X{ti)fj,{t 2 )s, for s G H^{G/B x G/R, £(a,^)), then the ring 

G = 0AGpR°(G/R X G/B,C(x-wo(\)))j 

is the subring of invariants under the action of the subgroup P G TxT defined 
as the intersection of the kernels of the characters (A, — ruo(A)) as A varies in 
P. Thus by [B], it is also normal with rational singularities. It follows that also 
the polynomial ring Gri? = G[xi, ... , x„] is normal with rational singularities. 
Using a result of Elkik [E, Theorem 4], we then deduce that R itself is normal 
with rational singularities. 

At this point, let us act on R with T hy ts = \{t)s if s G H^{X, L\). Then 
A is the subring of invariants under the action of the subgroup Ker(A). Thus 
again by [B], it is normal and with rational singularities. □ 

Let us now observe the following easy Lemma. Consider the coordinate 
ring k[G] of G. One knows that as a G x G-module, k[G] = ©A6P+End(VA)- 
We have 

Lemma 3.4. Given A,/x G P+, we set G>,^ = {p G P+ | yf 0}. 

Then, in k[G], 

End(UA)End(U^) = ©,ec.„End(K). 

Proof. If we consider k[G] as a G-module with respect to the G action in- 
duced by left multiplication, then End(VA) is the isotypic component of the 
irreducible module V\. It follows that if we consider End(UA)End(V^) as a 
G-module, each of its irreducible components has to be isomorphic to an ir- 
reducible module W with p G Gx,+ . 

The decomposition k[G] = ©A6P+End(UA) is a decomposition into distinct 
pairwise non isomorphic irreducible G x G- modules and End(UA)End(V^) is 
stable under the action of G x G. From this we deduce that there is a subset 
C'x ^ of Ga,^ such that 

End(UA)End(U^) = ©,eci,^End(K). 
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In particular 

End(I^A)End(F^) C 0,ec.„End(K). 

From these facts we see that in order to prove equality, it suffices to see that, 
as a G-module, End(y\)End(E^) contains a copy of IG for every v e C\^^. 

To see this, consider the open G-orbit in G/B x G/B, i.e.,the orbit of 
(B,B~), B~ being the opposite Borel subgroup to B with respect to T. 
Let 7T : G ^ G/B x G/B be the map defined by Tr{g) = g{B,B~) = 
{gBg~^ , gB~ g~^). Notice that tt can be written as the composition of the 
diagonal embedding G ^ G x G and of the G x G action. Take the line bundle 
G/BxG/B with the property that iL°(G/BxG/i?, 
as a G-module. Since G is simply connected, its Picard group is zero and we 
get an embedding tt* of H^{G/B x G/ B,L{^x,p.)) into k[G\. Since tt is G- 
equivariant, and factors through the diagonal G ^ G x G, we easily deduce 
that the image of n* is a copy of V\ 0 contained in End(EA)End(E^). In 
particular, it follows from the definition of Ga,^, that we can find a copy of 
Ey in End(EA)End(E«) for every ix G Ga,^, as desired. □ 

We now recall the PRV conjecture proved by Kumar [Ku] and Mathieu 
[Ma]. 

Theorem 3.5. Given two dominant weights A,/r, if a dominant weight v is 
of the form wX + w' g,, for some w, w' G W, then v G Ga,^. 

From this we deduce 

Theorem 3.6. [K] Let X,gGP. Then the multiplication map 
H^{X, Lx) 0 H°{X, L^) ^ H\X, Lx+^,) 



is surjective. 

Proof. As in the above Lemma 3.4, we can restrict to the open G-orbit and 
embed H^{X, Lx) into k[G] as the G x G-submodule ©.ygi;(A)End(Ey). Thus, 
following all our identifications and Lemma 3.4, we are reduced to prove that, 
given n G P+ with v < X + g there exist X' < X and g' < g both dominant, 
such that IX G Cx',n'. 

To see this, recall that the natural map Vx®V^ is surjective 

(since it is non zero, G-equivariant and Vx+p. is irreducible). So each weight 
appearing in Vx+^i can be written as a sum of a weight appearing in Vx and of 
a weight appearing in Vjj. Now notice that since ix < X + g and ix is dominant, 
for every w G W, wix < ix < X + g. We deduce that ix appears in Ea-i-;x • By the 
above remark write 

jx=X" + g" 

with X" appearing in Vx and g" in Ei. We now know that there exist w,w' 
such that A' = wX" and g' = w' g" are dominant and appear in Ea and in 
E^ respectively. The PRV conjecture then implies that v G and we are 

done. □ 
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Remark 3.7. Although the variety X is defined in arbitrary characteristic 
and both the computation of the Picard group of X and Proposition 3.2 hold 
(see [SI]), Theorem 3.6 is false in positive characteristic, contrary to the claim 
contained in the Appendix of [K]. 

The easiest example is the following. Let F be a field of characteristic 2. 
Let G = SL(4) and let A = W 2 be the second fundamental weight. 

Consider a matrix Y = (yij), 1 < *,J < 4, of indeterminates. Given two 
sequences 1 < ii < • • • < < 4 and 1 < ji < • • • < jA < 4 (of course 

h < 4), we denote by [A, . . . ,ih\ji, ■ ■ ■ ,jh] the determinant of the minor of 
Y formed by the rows and the columns ji,...,jh- We can then 

identify H^{X,Li^^) with the subspace of F[ 2 ;j^j] spanned by 2 x 2 minors 
of Y and H'^{X,L 2 u)^) with the span of the polynomials [s,t\s' ,t'][u,v\u' ,v'] 
and [s,t,u\s' ,t' ,u'][v\v'] with 1 < s,t,u,v, s' ,f ,u' ,v' < 4. The image of 
H^{X,Li^^) (g) H^{X, in iL°(X, L 2 W 2 ) is the the span of the polynomi- 
als [s,t\s' ,t'][u,v\u'v']. A direct computation (see [Br] section 4 and 5), shows 
that the polynomial [2, 3, 4|2, 3, 4] [Ijl] does not belong to this image. 

Notice that if we set V = then the coordinate ring of is the 

subring of F[j/j^j] generated by H'^{X, L^^). In [Br] it is also shown that this 
ring is neither normal nor Cohen-Macaulay. So we get that also Theorem 3.1 
does not hold in this case. 

Using Theorem 3.6 we can now prove the first part of our Theorem 3.1, 
namely that Z\ is a normal variety with rational singularities. 

To see this let us see that k[Z\] = A. Since both rings are graded and 
generated in degree 1, (A[Zv] by definition and A by the Theorem 3.6) and 
since k[Z)^ C A, it suffices to see that the two rings coincide in degree 1. Now 
Ai = H^{X,L\) = ©^ei;(A)End(V)j). On the other hand, the degree one part 
k[Z\]i of k[Zx], is the G x G-module spanned by the identity in End(lTA). 
Since W\ = ©^6i;(a)V)., it is immediate that k[Zx]i = ©;xei;(A)End(V),), 
proving our claim. 

It remains to prove the second part of Theorem 3.1. By our assumption on 
V, we have that there is a subset 17 C A7(A) containing A and positive integers 

for /i G 17, such that 

If we take the identity map I G End(U), we then deduce that the GxG span of 
I is isomorphic to ©^g j 7 End(V)j) . It follows that we can assume, without loss of 
generality, = 1 for all /x G 17. Also we deduce that Zy C ©^gj 7 End(V)j). In 
particular, as we have already seen above, we get that Zx C ©^gi;(A)End(V)i). 
We thus have that the obvious G x G-equivariant projections 

©M£i:(A)End(V'^) ^ ©^gj7End(V),) ^ End(UA) 
restrict to dominant morphisms 

Za ^ Zv ^ Za. 

Thus we get inclusions k[Zx] C k[Zv] C k[Zx]- 
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Notice that k[Zv] = k[Z\] if and only if = N'(A), since only in this case 
do the two rings coincide in degree 1. Also using the above inclusions, it is 
clear that in order to show our claims, it suffices to see that k[Z)^ and k[Z)^ 
have the same quotient field and that k[Z\] is integral over k[Z}]. 

Let us see that k[Z)^ and k[Zy] have the same quotient field. Indeed both 
the representation of G x Gm in Gl{V\) and of G x Gm in Gl{W\), have as 
kernel the subgroup S C Z{G) x Gm, Z{G) being the center of G, consisting of 
those pairs (z,t) e Z(G) x Gm for which \{z)t = 1. This clearly implies that 
Z\ and Z\ contain the dense open set G x Gm/S, hence they are birational. 

It remains to see that k[Z\] is integral on k[Z\], For this, it is clearly 
sufficient to show that the degree one part of k[Zx] is integral over k[Zx\. 

Restricting to the open Gx G-orbit, we can identify, for each m, the degree 
m part k[Z\]m of k[Z\] with the subspace of k[G] spanned by the products 
/ 1/2 • • • fm, with fi e End(Vx). Using Lemma 3.4 we deduce that as a G x G- 
module, 

k[Zx]m = 0 End(K). 

From this we see that our claim will immediately follow from the following 
statement. 

Proposition 3.8. (Cf. also [T] Lemma 1) Let /i, A be dominant weights. As- 
sume that fj, < X. Then there exists a positive integer H such that Vh^ is an 
irreducible component ofV^^. 

Proof. We know that p, is a, convex linear combination of the weights wX, as 
w varies in the Weyl group W. So let us write 

p = OilCiA H + amWmX 

with 01 + 02 + - • - + 0 ^, = 1, Oi > 0, Oi rational. Let us make induction on m. If 
m = 1 there is nothing to prove, since the fact that A is the unique dominant 
weight in its IF-orbit clearly implies that p = X. Assume m > 2. Write 

p = aiWiX + (1 — oi) ( — W2X + • • • + WmA ) . 

V 1 — oi 1 — oi / 

Now notice that there is a positive integer N such that 

p = n(-^ — W2X H h WmX) 

V 1 — oi 1 — oi / 

= ~^^W2NX + • • • + -^^WmNX G P, 

1 — Oi 1 — Oi 

is a convex combination of m — 1 IF-translates of iVA. Thus also every W- 
translate of p has the same properties and, by the inductive hypothesis, if we 
denote by p the unique W-translate of p which lies in P+, we obtain that 
there exists a M such that Vmjz is an irreducible component of . But 
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we know that is a summand of so that Vmjz is an irreducible 

component of _ Let us now consider 

NMfx = a\W\N M \ + (1 — ai)Mjl. 

Since 0 < oi < 1, we can find two positive integers s and r with r < s and 
oi = r/s. Clearing denominators, we obtain that 

sNM^ = w\rNM\ + (s — r)Mfi. 

Now (s — r)Mjl is a Vb-translate of (s — r)MjI, so that applying the PRV 
conjecture, we deduce that Vsnm^i is an irreducible component of Vtnmx 
V(^ s-r)Mji- On the other hand VrNMX is an irreducible component of 
while V(s_r-)M 7 i is an irreducible component of which in turn is a direct 

summand of i~)nm ^ Thus Vsnm^ is an irreducible component of 

y®rNM ^ y®{s-r)NM _ y0sNM 

Setting H = sNM we obtain our claim. □ 

Remark 3.9. In [DCP, section 4], it is shown that whenever A is regular, then 
both X{V\) and X{W\) are isomorphic to X. This can be used to deduce 
directly that k[Z)^ is integral on k[Z\]. Also we have that Z\ contains the 
origin as its unique singular point and the natural projection 



f-.Zx^Zx 

is bijective. But as we have proved in Theorem 3.1, it is an isomorphism only 
for G = SL(2)” and A = (wi, . . . , wi), in which case Z\ is the cone over the 
Segre embedding of (P^)". 



4 A Generalization 

As in the previous section, G will denote a semisimple simply connected al- 
gebraic group over k, T G G a, maximal torus and B C G a Borel subgroup 
containing T. We shall continue to denote by G the adjoint quotient of G. 

We now take another semisimple simply connected group Q, a maximal 
torus T in Q and a Borel subgroup B G T in Q. We shall set P = X{T), the 
character group of T. Let A C P denote the set of roots, and let A+ C A be 
the positive roots relative to B. Finally, let P+ be the semigroup of dominant 
weights. 

We now assume that Q contains a parabolic subgroup V G B having 
the following property. If S' C 7^ denotes the solvable radical of V, we have a 
surjective homomorphism tt : V /S GxG with finitekernel. Equivalently we 

assume that the semisimple Levi factor of V is isogenous to GxG. Composing 
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7 T with the quotient homomorphism V V / S, we get a surjection tt' : 7^ — > 

GxG. 

We set K equal to the preimage under tt' of the diagonal subgroup in 
GxG. 

Notice that we get an action of G x G on S' and a surjective homomorphism 
'y : Sx{GxG) ^ V with finite kernel. Using 7 , we can consider any 7^-module 
and hence any ^-module as a S x (G x G)-module . 

Let us consider now the wonderful compactification X of G and define 

y = gxvX. 

We want to make a study of some of the properties of y. This study is in 
fact essentially identical to that of X, so that we shall only sketch the proofs 
of the various assertions. First of all notice that, since we have an obvious 
^-equivariant fibration 

p-.y^ Giv, 

with fiber X, we immediately deduce that all ^-orbits in y are of the form 
G x-p O, O being a G x G-orbit in X. This gives a codimension preserving 
bijection between ^-orbits in y and G x G-orbits in X with the property that 
since G jV is projective, if O is any G x G-orbit in Jf, then G Xp O = G ■ 
In particular each orbit closure in y is smooth. 

Recall that the complement of the open orbit, which is isomorphic to G jK, 
is a divisor T> with normal crossings and smooth irreducible components T>i, 
i = l,...,n, each of which is the closure of a 5-orbit. Furthermore, each 
orbit closure in y is the transversal intersection of those among the Vi’s 
which contain it. Finally y contains a unique closed orbit which is 

isomorphic to G x-p {G/B x G/B) ~ G/B. 

We are now going to determine the Picard group of y. Recall that in 
the previous section we have seen that the homomorphism i* : Pic(X) ^ 
Pic(G/i? X GjB) induced by the inclusion i : G/B x G/B ^ X as the 
closed orbit is injective and has as image the lattice consisting of pairs of 
the form (A, — rco(A)), wq being the longest element in the Weyl group W. 
Consider now the inclusions j : G/B ^ y as the closed orbit and the inclusion 
h : G/B X G/B ^ G/B as the fiber over [V] of the fibration G/B ^ G /V . We 
have 

Proposition 4.1. The homomorphism j* : Pic(3f) ^ V\c{G/B) is injective 
and has as image the lattice (/i*)“^i*(Pic(X)). 

Proof. We have a commutative diagram of inclusions 

G/B X G/B G/B 




where h is the inclusion of X as the fiber over [P] of the fibration y G /V. 
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Now observe that since y has a finite number of orbits, it contains a finite 
number of fixed points under the action of T. Thus applying [BB], we deduce 
that y has a paving by affine spaces. The same is true both for Q jV and for 
X. Using this fact and the previous diagram, we get a diagram 

0 ^ Pic(5/lP) Pic(0/,8) Pic(G/B x GjB) ^ 0 

id i* i* 

0 ^ BiciQlV) Pic(J^) ^ Pic(X) ^ 0 

whose horizontal sequences are exact. Now recall that i* is injective. This 
clearly implies that also j* is injective and has as image (/i*)“^i*(Pic(X)) as 
desired. □ 

Now that we have computed the Picard group of y, we can proceed to 
analyze the space of sections of a line bundle on y. We can clearly assume 
that the homomorphism n' : V ^ G x G takes the Borel subgroup B to the 
Borel subgroup Bx B, which is the image in G x G of B x B and also takes the 
maximal torus T to the maximal torus T x T, which is the image in G x G of 
TxT. We can also assume that under the homomorphism j : Sx{GxG) ^ V, 
TxT is mapped to T. Set Q equal to the root lattice X{T). Our various maps 
induce homomorphisms 



Q®Q > p — ^ P0 P , 

with the composition being the inclusion of the root lattice into the weight 
lattice for the maximal torus TxT in GxG. Clearly we can identify P0P with 
Pic(G/i? X G/B), P with Vic{Q /B) and 7* with h* . So Pic(3f) gets identified 
with the sublattice of P consisting of those elements A such that 7* (A) = 
(A', — ■u;o(A')) for a suitable A' e P. In particular Pic(3f) contains a copy of 
the root lattice Q. This lattice consists of the elements f = 7r'*((r, — wot)), 
T G Q (we want to stress that in all this discussion wq denotes the longest 
element in the Weyl group of G). Let {oi,. C Q denote the set of 
simple roots with respect to the Borel subgroup B C G and {di, . . . , d„} the 
corresponding subset of P. 

Before we proceed, let us prove a well known and easy Lemma. Let lA <ZP 
denote the unipotent radical in V . Given a ^-module M, set equal to the 
subspace of vectors which are invariant under the action of U. is clearly 
a G X G-module. 

Lemma 4.2. The Q-module M is irreducible if and only if the G x G-module 
is irreducible. 

Proof. M (resp. M^) is irreducible if and only if contains a unique line stable 
under B (resp. B x B). But a line stable under B is automatically contained 
in and a, B x B stable line in is automatically B stable, so that M is 
irreducible if and only if is irreducible. □ 
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We now have 

Proposition 4.3. Let X G Pic(3^) and let L\ he the corresponding line bundle 
on y, C\ its restriction to Q/B. The the restriction map 

H^{y,Lx)^H°{g/B,Cx) 

is surjective. 

Proof. We can clearly assume that A is dominant. Otherwise H^{G /B,£\) 
= 0 and there is nothing to prove. If A is dominant, then H^{G /B, C\) = 

M\ being the irreducible module of highest weight A. We get an associated 
morphism f} : QjB ^ ¥{M\). We are going to extend this morphism to y. 
This will clearly imply our claim. 

As we have seen in the previous Lemma, the subspace is an irreducible 
G X G-module whose highest weight is of the form (A', — wo(A')), since A G 
Pic(3^) for a suitable dominant weight A' G P+. It follows that, as a G x G- 
module, is isomorphic to End(VA')- 

Consider the identity map in J G End(VA') = C M\. The line spanned 
by I is clearly stable under the action of V and so is the corresponding point 
[/] G P(M^). In the previous section, we have seen that we have a G x G- 
equivariant morphism from X onto the closure of the G x G-orbit of [/]. 
It is clear, from the above considerations, that this morphism is indeed V- 
equi variant . 

Using the G action and the inclusion P(M^) ^ F{M\), we then obtain a 
0-equivariant morphism 

i,:y = Gx-pX^F{Mx) 

which clearly extends ip as desired. □ 

Once the above result has been established, most of the results which 
follow are proven exactly as in [DCP, section 8] or as in section 3, so we leave 
their proof to the reader or only sketch them. The first is the following. 

Proposition 4.4. We can order the divisors T>i, i = 1, . . . ,n in such a way 
that, under the above identifications, the class in Pic(3f) of 0{Df) is cxi. 

Let us now choose for each i= 1, . . . , n, a non zero section ti G H^{y, LfiJ 
whose set of zeros is T>i. 

Consider the ring 

TZ= 0 H°{y,Lx). 

AePic(y) 

As in section 3, given sequences h = {hi , . . . , /i„} and k = {ki , . . . , k„} of non 
negative integers, we shall say that k > h ii ki > hi for each i = 1, . . . ,n and 
set \h\ = hi + . . . + hn. If we now fix such a sequence h, we set TZh{\) equal 
to the image of the map 

H\y,Lx-^ H\y,Lx) 
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given by multiplication by ■ ■ ■ tjj". Clearly TZkW C TZh{\) if and only if 
k> h and ©A6Pic(y)’^/i(^) is the ideal generated by ■ ■ ■ tjj". 

Theorem 4.5. (1) For each A G Pic(3f), 

7^^(A)/^7^fc(A) 

k>h 

is isomorphic as a Q-module to H^{Q /B,L\-Y^,hiai)- In particular as a Q- 
module, we have an isomorphism 

(2) If we set 

C= 0 H°{g/B,£x), 

AePic(y) 

and 

0 %(A)= E 

|?i|=i,AePic(y) \h\=i 

then associated graded ring 



GvIZ — (Bi>oTZi/TZiJ^i 

is isomorphic to the polynomial ring C[x\, . . . , x„], where for j = 1, . . . ,n, xj 
is the image of the tj in TZi/TZ 2 - 

(3) Let A G Pic(3f) be a dominant weight. Then the ring 

7^A = 0 H^{y,L^x) 

n>0 

is normal with rational singularities. 

Proof. The proof of (1) is identical to that given in [DCP] for the case of 
X. (2) then follows repeating the proof of Proposition 3.2 and (3) the one of 
Proposition 3.3. □ 

Before we proceed, let us remark that, by Lemma 4.2, the restriction of 
the map 

h*:M = H\g/B,Cx) ^ H\G/B x G/B, £a|g/bxG/b) 

to is an isomorphism for all dominant A G P+. Using this we obtain 
Proposition 4.6. Let A,/x G Pic (3^) H Bf, then the multiplication map 
m : H^{y, Lx) © H^y, L^) ^ H^{y, La+m) 



is surjective. 
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Proof. Since the map m is ^-equivariant and H^{y generates 
H^{y as a ^-module, it is sufficient to show that the restriction of 
m to the fi-invariants is surjective. 

Using the notations of Section 3, notice that, by the definition of the 
divisors T>i, the restriction of the section U to X is, up to scalar, the section 
Si vanishing on the boundary divisor Di oi X. This implies that we have, for 
each h = {hi , . . . , /i„) and for any A G Pic(3f), a commutative diagram 



H°{y, H^{y, Ta) 






h* 

'' 



H°{X,L^^x) 



Setting h*{\) = (A', — ruo(A')) and, by abuse of notation, still denoting by h* 
the map induced by h* on a subquotient, we get a commutative diagram 

T^h{\)/ Y.k>M\) H^{g/B, £ a - e , 



h* 



h* 



Rh{^')/ 



H°{G/B X G/B,C(^x'-Y.ihiai-wo{X'-Y:ihiai))) 



where the horizontal arrows are isomorphisms. Now assume that A is domi- 
nant. Then it is easy to see. A' — hiUi is dominant if and only if A — /lidi 
is dominant. This implies, by the remark made before our Proposition, that 
for all h, 

h* : H^{Q /B,Cx-Y^.hiai)^ H°{G/B x G/ B,C(^x'-Y,,hiai-wo(x'-Y,ihiai))) 

is an isomorphism, so that also the restriction of h* to the space of U invariants 
is an isomorphism. 

Take X,fj,GP+. We get a diagram 



H^{y, LxY ® H^{y, H^{y, ^A+^f 



H°{X,Lxix)^H°{X,L^^^)^ 

where the vertical arrows are isomorphisms. 
By Theorem 3.6, we have that the map 



h* 



H°{X,Lx+i.^^) 



H°{X, Lxix) ® H°{X, H°{X, Ta+m|x) 



is surjective and this, together with our previous considerations, implies our 
claim. □ 
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We are now going to use the properties of y to study certain orbit closures. 
Let us take a representation M oi Q and a non zero vector v G M which, 
as we can suppose without loss of generality, spans M as a ^-module. The 
assumptions we are going to make on v are 

Assumptions 4.7 1) There is a character x'K^k* such that kv = x{k)v, 
for all k € K. 

2) Let W C M be the G x G- module spanned by v. Then W is a highest 
weight module. 

Let us make some considerations. By assumption 1) the diagonal subgroup 
in G X G fixes v, so that the orbit map G x G ^ {G x G)v factors through 
the map f : G x G ^ G given by f {{ 91 , 92 )) = 9i92^, for all 91,92 G G. 
Thus, we get an G x G-equivariant inclusion of the vector space W into the 
coordinate ring k[G]. In particular, using assumption 2), we deduce that there 
is a dominant A' G P+ and a subset 17' C A7(A') containing A', such that, as a 
G X G-module, 

Wcx(B^>en'^nd{V^,). 

Also, by assumption 1), we have that V preserves the line spanned by v, so 
that W is stable under the action of V and W C . Since v spans M as 
a tj-module, we deduce that indeed W = . Using Lemma 4.2 and our 

description of Pic(3f), we then deduce that there is a subset 17 C Pic(3f) 
mapped bijectively onto 17' by h* : Pic(3f) ^ Pic(A) = P such that, as a 
tj-module, 

M ~ 

Definition 4.8. The variety Y{v, 17) is the cone over the orbit Qv, i.e.,if we 
let Gm act on M by homotheties, 

Y{v, n) = {Q X Gm)v. 

In order to simplify notations we denote by U the G-module 
We have 

Lemma 4.9. Set Z = {V x Gm)v C W. Then 

(1) Z is isomorphic as a G x G variety to Zu- 

(2) Y{v,n) = gz. 

Proof. (1) Notice that up to rescaling, we can assume that the isomorphism 

W^©^.6i;End(V) 

has the property that ip{v) = other hand, we have 

a G X G-equivariant inclusion of ©^gi;End(V)j) into End([/) taking 
to the identity. Composing, we get a G x G-equivariant inclusion ip : W ^ 
End([/) with 'ij}{v) = Id;/. Clearly the restriction oi ip to Z gives the required 
isomorphism with Zij. 
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(2) Since both Y{v,0) and Z are cones, it suffices to show that QZ = 
Y{v,n) for the projective varieties Z = {Z — {0})/Gm and Y{v,0) = 
{Y{v, fi) — {Q})/Gm- Notice that Z is 7^-stable, so that the morphism Qx Z ^ 
Y{v,f2) factors through Q Xp Z . Since Q jV and Z are complete, also Q Xp Z 
and hence its image QZ are complete, proving that QZ coincides with Y (y, f2). 
□ 

Notice that HQ — V = GxG, then the variety Y{v,f2) coincides with the 
variety Zjj considered in Section 3. 

The following Lemma strongly restricts our choice of G. Let A G 17 be the 
unique element such that h*{\) = A'. Given y' = — ^ hiUi G N’(A'), we set 

pxifj,') = A — ^ hiCti. Notice that the set 17(A) := px{Y{\')) coincides with the 
set of highest weights of irreducible components of the ^-module H^{y,Lx)- 

Lemma 4.10. 17 = px{G'). In particular 17 C 17(A). 

Proof. By what we have seen in Section 3, we have a G x G-equivariant mor- 
phism 

f}-.X^Z. 

So we deduce from part 2) of the previous Lemma that we have a surjective 
tj-equivariant morphism 

cf-.y ^Y{v, 12 ) 

whose restriction to X equals ip. The line bundle on y which is the pull back 
of 0{1) on Y{v,f2) is equal to Lx for some A G Pic (37) with the property 
that h*{X) = A'. It follows that the ^-module M is a direct summand in 
H^{y, Lx)*. Thus Proposition 4.6 implies our claim. □ 

We are ready to show: 

Theorem 4.11. 1) The variety Y{v,f2) is normal with rational singularities 
if and only if 12 = 17(A). 

2) For a general 17 C 17(A), T(u, 17(A)) is the normalization ofY{v,f2). 
In particular Y (v, {A}) is normal if and only if X' is minuscule. 

Proof. The argument given in the above lemma implies that we can iden- 
tify the coordinate ring k[Y(v,f2)] of Y(y,f2) with the subring of the ring 
Tlx = 0n>o77°(37, L") generated by the Q submodule M* C H^{y,L'f). In 
particular, notice that, up to isomorphism, Y{v,f2) depends, as a ^-variety, 
only on 17 and not on the choice of a specific vector v (of course provided that 
the Assumptions 4.7 are satisfied). 

We can now prove Theorem 4.11 exactly as we have shown Theorem 3.1. If 
17 = 17(A), we get that k[Y{v, 17(A))] and TZx coincide in degree one by Theo- 
rem 4.5. Since by Proposition 4.6 they are both generated by their degree one 
components, we deduce that k[Y{v, 17(A))] = Tlx. In particular k[Y{v, 17(A))] 
is normal with rational singularities. 

It remains to see that, if 17 C 17(A), then k[Y{v, 17)] is not normal. This 
follows in a way completely analogous to the corresponding statement for Zy, 
which has been seen in Section 3, so we leave the details to the reader. □ 
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Theorem 4.11 can be extended as follows. Suppose G = Gi x ■ ■ ■ x Gg- 
Let Ml , . . . , Mg be ^-modules and vi, ... ,Vg be vectors with Vi G Mi each 
satisfying Assumptions 4.7. Assume furthermore that for each i = 1, . . . , s, and 
j yf i, Gj X Gj fixes Vi. By what we have already seen, for each i, Mi is a highest 
weight module of highest weight \ and we get a subset G C Pic(3f), 
such that Mi ~ Also, we have the subsets 17' = h*{Qi) C P+. 

Denote by S the subspace in M = Mi 0 • • • 0 Mg spanned by the vectors 

Vi,...,Vg. 

We then define Y{vi, . . . ,Vg] Qi, . . . , fig) as the closure of QS C M. One 
obtains 

Theorem 4.12. 1) The variety Y{vi, . . . ,Vg; l7i, . . . , I7g) is normal with ra- 
tional singularities if and only if Qi = l7(Ai) for each i = 1, . . . , s. 

2) For a general sequence 17i, . . . , 17^, with Qi C l7(Ai), the normalization 
ofY{vi,. . . I7i, . . . , 17s) is given by Y{vi, ...,Vg, 17i(Ai), . . . , l7s(As)). In 
particular, Y{vi, . . . ,Vg; {Ai}, . . . , {As}) is normal if and only if A' is minus- 
cule for each i = 1, . . . , s. 

Proof. Let F C T he the intersection of the kernels of the characters A^. 
It is easy to see that the definition of the Aj’s implies that the coordinate 
ring of y(wi, . . . , Us, l7i(Ai), . . . , l7s(As)) can be identified with the ring of F 
invariants in 

n= 0 

AePic(y) 

the T action being given by ts = \{t)s, if s G H^{y,L\), t gT. 

This immediately implies that Y{vi, . . . ,Vg, l7i(Ai), . . . , l7s(As)) is normal 
with rational singularities. We leave the rest of the proof to the reader. □ 



5 Some Examples 

In this section, using the notations of the previous sections, we are going to 
make a number of examples of varieties of the form Y (vi, . . . ,Vg; I2i, . . . , f2g). 

Example 5.1. Assume Q is arbitrary and V = B is a, Borel subgroup. Then 
necessarily G = |e} the trivial group. We can then take any dominant weight 
A G P and consider the irreducible tj-module M\. Then necessarily u is a 
highest weight vector and the variety Y (v, {A}) is just the affine cone over the 
unique closed orbit in F{M\). Notice that in this case, y(u,{A|) is normal 
with rational singularities in accordance with our result (every representation 
of the trivial group is minuscule). However, we remark that we have used this 
fact to prove our result. 

Example 5.2. Let us start with the case of one of the semigroups Zy. Take 
G = SL(n) and let V be its fundamental representation f\^ k^. Then it is easy 
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to see, as we have already remarked in Section 3 in a special case, that the 
coordinate ring k[Zv] is nothing else than the subring of the polynomial ring 
k[xi^j],i,j = l,...,n, generated by the determinants of the hxh minors of the 
matrix (xij). More generally, assume Q = SL(n) x SL(m) and G = SL(/i) with 
h < min(m, n). Take V = Hom(/\’' fc", /\^ fc™) for some r < h. Consider k^ as 
a subspace of both fc^and fc" in the obvious way, so that we have an inclusion 
of End(/\*^ into Hom(/\’' fc", fc™). Take v to be the identity map in 
End(/\*^ k^). Then, since /\^ k^ is a minuscule SL(/i)-module , we deduce that 
the corresponding variety Y(v,f2) is normal with rational singularities. It is 
clear from our description, that the coordinate ring of E (y, C) can be described 
as follows. Consider the ring R = k[xij]/Ih with i = 1, . . . ,n, j = 1, . . . , m 
and Ih equal to the ideal generated by determinants of/i+lx/i+1 minors 
of the matrix (xij). Then k\Y{y,Q)] is the subring of R generated as a k 
algebra, by the determinants of r x r minors of (xij) (in particular if r = 1, 
Y(v, 17) is the determinantal variety of n x m matrices of rank less than or 
equal than h) . The fact that this ring is normal with rational singularities, at 
least when h = min(n,m), has been originally shown in [Br], see also [BrC]. 

Example 5.3. Suppose now Q = Sl(no) x Sl(ni) x ••• x Sl(ni.), fix a se- 
quence of non negative integers {hi,h 2 , ■ ■ ■ ,hr) with hi < min(no,ni), 
hi < min(ni_i — hi-i,rii), for 2 < i < r. Set v = {vi,V 2 , ■ ■ ■ ,Vr) G 
Hom(fc"“, fc"i) 0 Hom(fc"i , fc"^) 0 • • • 0 Hom(A:"’'-i , fc"’’) where, letting Ih de- 
notes the identity hxh matrix, we have 



Vi = 




if i is odd. 



Vi = 



fO 0 



if i is even. 

Notice that Vi+iVi = 0 for each i = 1, . . . , r — 1. G = Sl{hi) x ■ ■ ■ x Sl{hr) 
and the G x G-module spanned by v is just End(fc^i) 0 • • • 0 End(fc^’’) so 
that the conditions of Theorem 4.12 are satisfied. Furthermore for each i, 
Qi = {wi}, a minuscule weight. We deduce that the variety 



Y{vi,V 2, ■ . ■ ,Vr-,{u>i}, . . . ,{u}i}) 



is normal with rational singularities. The fact Vi+iVi = 0 for each i = 1, . . . , r— 
1 clearly implies that Y{vi,V 2 , ■ ■ ■ , vy {wi}, . . . , {wi}) is nothing else than the 
variety of complexes with rank conditions {h\, h 2 , ■ ■ ■ , hr), i.e., it is the variety 
of sequences (f/'i, . ■ . , ipr) in Hom(fc”o, fc"i) 0 • • • 0 Hom(fc”’— ^ , fc”’') such that 
ipi+iipi = 0 for i = 1, . . . , r — 1 and rkipi < hi for i = 1, . . . , r. The fact that 
varieties of complexes have rational singularities is well known (see [Ke], [DS] 
or, for a more recent reference [MT]). 
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Example 5.4. Suppose now Q = SL(n) x SL(m), and fix a pair of non negative 
integers (h,s) with h + s < min(n,m). Define v = (vi,V 2 ) € Hom(k", k'") 0 
Hom(fc’”,fc") by 



Vl 



Ih 0 
0 0 



V2 = 



0 0 
OL 



(As before, Ih and A are identity matrices of size h and k respectively). G = 
SL(/i) xSL(s) and the GxG-module spanned by v is just End(fc^)0End(fc®), so 
I2i = {wi} for i = 1, 2. Reasoning as in the previous example, we deduce that 
E(ui, U 2 ; {wi}, {wi}) is normal with rational singularities. Now notice that 
V 1 V 2 = 0 and V 2 V 1 = 0. From this, it is immediate that Y{vi,V 2 ', {wi}, {wi}) 
is the variety of circular complexes with rank conditions (h,s), i.e.,it is the 
variety of pairs {ipi,ip 2 ) in Hom(fc",fc’") 0Hom(A:™,fc") such that V’iV ’2 = 
0 = 0 and rk^/’i < h, Tk'ip 2 Y s. These varieties have been studied in 

[S] and in [MTl]. 



Example 5.5. As a final example, let V be an n-dimensional vector space 
with a non degenerate symmetric or antisymmetric bilinear form (in this case 
dimE is even). We let G be the group of isometries with respect to the form: 
i.e.,G = SO(E) if our form is symmetric, G = Sp(E) if it is antisymmetric. 
Given a linear tranformation A G End(E), we denote by its adjoint with 
respect to the form. Then the variety Zy is the variety of linear tranformations 
A G End (V) such that *AA = A^A = tl, for some t G fc (/ is the identity) 
and, if G = SO(E) and dimE is even, det A = t". Since E is a minuscule 
representation if and only if dim E is even, we deduce that in this case Zy 
is normal with rational singularities. If on the other hand dim E is odd, the 
normalization of Zy is given by Zw, with IE = E 0 fc. 
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In continuation of [HMl], [HM4] and [Hw], we work on the following conjec- 
ture. 

Conjecture. Let tt : X ^ A := {t G C]\t\ < 1} be a smooth projective 
morphism from a complex manifold X to the unit disc. Suppose the fiber Xt := 
7r“^(t) is biholomorphic to a rational homogeneous space of Picard number 1 
for each t yf 0. Then Xq is also biholomorphic to the rational homogeneous 
space. 

Recall that a rational homogeneous space of Picard number 1 is the ho- 
mogeneous space of a complex simple Lie group modulo a maximal parabolic 
subgroup. We say that the rational homogeneous space of Picard number 1 is 
of type (g, a) when g is the complex simple Lie algebra and a is the simple root 
determining the maximal parabolic subgroup. By the results of [HMl], [Hw] 
and [HM4], the conjecture was proved for all rational homogeneous spaces of 
Picard number 1 excepting the following three cases. 

(1) type (Cl, a) where a is a short root, 

(2) type (P4,ai), 

(3) type (^ 4 , 02 ). 

Here the numbering of the simple roots {a\,a 2 , 01 ^, 014 } of F 4 is chosen 
such that «i and «2 are short and the highest long root is of the form 
2a\ + 402 + 3q;3 -|- 2 a 4 . The proof of [HMl], [Hw], [HM4] uses the natu- 
ral distribution of smallest rank on the homogeneous space. In these settled 
cases, this distribution agrees with the distribution defined by the variety of 
minimal rational tangents (cf. definition in Section 3 below), which enables 
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one to recover the structure of the homogeneous space from the data of ratio- 
nal curves. In the remaining three cases, these two distributions do not agree. 
However in case (3), the distribution defined by the variety of minimal rational 
tangents agree with a natural distribution on the homogeneous space albeit 
not the minimal one. This suggests that the proof of [HM4] can be modified 
to attack the case (3). This is precisely what we will do in this article. Our 
main result is the following. 

Main Theorem. Let G be a complex simple Lie group of type F 4 and let P 
he the maximal parabolic subgroup associated to the root 02 - Let tt : X ^ A := 
{t G C I |t| < 1} be a smooth projective morphism from a complex manifold 
X to the unit disc. Suppose each fiber Xt := 7r“^(t) is biholomorphic to G/P 
for each t ^ 0. Then Xq is also biholomorphic to G/P. 

From now on, G/P denotes the homogenous space of type (F 4 ,a 2 )- As in 
[HM4], the essential step of the proof of the main theorem lies in establishing 
that the symbol algebra of the differential system on the rational homogenous 
is determined by the projective geometry of the variety of minimal rational 
tangents. In [HM4], Proposition 5, this fact was proved for the homogeneous 
spaces associated with long roots by realizing that the condition on the sym- 
bol algebra arising from the tangent lines to the variety of minimal rational 
tangents is equivalent to the finiteness condition in the Serre presentation of 
the simple Lie algebra. The main difference of the current paper from [HM4] 
is that the symbol algebra structure cannot be recovered easily by such al- 
gebraic results as the Serre presentation. In the current situation, one has to 
recover the structure more directly by studying the projective geometry of the 
variety of minimal rational tangents. For this reason, a large part, three out 
of four sections, of the paper is devoted to a geometric study of the variety 
of minimal rational tangents for G/P, which is essentially independent from 
the deformation rigidity problem. 

The projective variety corresponding to the variety of minimal rational 
tangents for G/P will be denoted by Z. In the first section, we will study Z 
as a complex manifold. Here the key result is a certain rigidity for Z . In the 
second section, the projective geometry of Z under a natural embedding in 
the projective space will be discussed. The third section is to show that this 
Z is indeed isomorphic to the variety of minimal rational tangents of G/P. 
The Main Theorem will be proved in Section 4. 

For the remaining cases (1) and (2), the distribution spanned by the va- 
riety of minimal rational tangents is the full tangent space. In this sense, the 
approach of studying the symbol algebra of the distribution defined by the 
variety of minimal rational tangents is of no help. In another paper [HM5], we 
have settled cases (1) and (2) in the affirmative by a new method involving 
the study of holomorphic vector fields on uniruled projective manifolds. 
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1 Z As a Complex Manifold 

Our variety Z as a complex manifold is quite simple. Let £ be a vector bundle 
of rank 4 on Pi with a subbundle V of rank 3 such that V = 0(1)^ and 
£jV = 0. Note that the subbundle V is uniquely determined by this property. 
We define 

Z:=G{2;£*), 

the Grassmannian bundle of 2-planes in the dual bundle £* . We denote by 
?7 : Z — > Pi the natural projection to Pi. Let ^ be the Pliicker bundle on Z 
satisfying 

2 

774 = f \£- 

Let A* C £* be the line subbundle annihilating the subbundle V so that the 
quotient bundle £* /A* is canonically isomorphic to V*. Let S C Z = G(2,£*) 
be the Schubert subbundle corresponding to the 2-planes in £* containing 
the line bundle A*. Then there is a canonical identification S = PV*. The 
projection rj\s : S' ^ Pi will be denoted by x- Under the identification S = 
PV*, the restriction of ^ to S, which will be denoted by the same letter 
agrees with the hyperplane line bundle of the projectivization so that 

= V. 

A rational curve on Z will be called a line if it has degree 1 with respect to 
^ and a conic if the degree is 2. It is easy to see that a line is contained in 
a fiber of t] or in S. In fact, any rational curve which is contained neither in 
a fiber of rj nor in S can be deformed under the action of the automorphism 
group of Z as a fiber bundle to a reducible curve with components both in 
fibers of 77 and in S. Thus 

Lemma 1.1. For a line C in Z, —Kz • C < 4. 

The rest of the section is devoted to the proof of the following rigidity. 

Proposition 1.2. Let if) : Z ^ A he a smooth projective morphism and 
be a line bundle on Z. Suppose for each t ^ 0, the fiber Zt := 'ip~^{t) is 
biholomorphic to Z and f\zt is isomorphic to the line bundle f on Z. Further 
assume that for any flat family of curves {Ct C Zt | t G A}, 

(a) if Ct has degree 1 with respect to f, the limit curve Co is irreducible, 
and 

(b) if Ct has degree 2 with respect to (, then the limit curve Co is either 
irreducible or a union of two irreducible curves of degree 1 with respect to f. 

Then Zq is also biholomorphic to Z. 

We will say that a point of a uniruled complex manifold is very general 
if any rational curve through that point is free in the sense that the pull- 
back of the tangent bundle of the complex manifold to the normalization of 
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the rational curve is a semi-positive bundle on Pi. It is well-known that the 
complement of the set of very general points is a countable union of proper 
subvarieties. The following stability result will be useful. 

Lemma 1.3. Let Utg/iMt be a smooth family of uniruled complex manifolds. 
Then for any rational curve C passing through a very general point of Mq, 
there exists a flat family of rational curves Ct C Mt with Cq = C. 

Proof. This is a direct consequence of Kodaira’s stability ([Ko]). Note that 
the obstruction to deforming a holomorphic map / : Pi ^ Mq out of Mq is 
iJ^(Pi, f*T{Mo)) which vanishes when C = /(Pi) is free on Mq. □ 

The following lemma is a direct consequence of the basic deformation 
theory of rational curves. 

Lemma 1.4. Let C C M he a free rational curve on a complex manifold. Sup- 
pose there exists a point P G C and an m-dimensional family of deformations 
of C fixing P such that the members of the family are all distinct rational 
curves. Then —Km • C > 2 m. 

Now we start the proof of Proposition 1.2. For t yf 0, let Qt be the foliation 
on Zt given by the fibers of the Grassmannian bundle rj : Z —> ¥i. The leaves 
are hypersurfaces in Zt biholomorphic to G(2;C‘^), which is biholomorphic 
to the 4-dimensional smooth hyperquadric Q 4 . Let Qq be the foliation on a 
Zariski open subset of Zq defined by taking limits of Qt. Leaves of Qq can be 
compactified to hypersurfaces in Zq. 

Lemma 1.5. Let y G Zq be a generic point and 0 : A ^ Z be a section of tp 
with 0(0) = y. Let Qt be the Qt-leaf through Oft) on Zt,t yf 0. Then the limit 
Qq is an irreducible hypersurface in Zq. 

Proof. Without loss of generality, we can assume that y is a very general 
point of Zq. If Qq is reducible, choose families of points {At G Qt \ t G A} and 
{Bt G Qt \ t G A} so that Aq and Bq are generic points of distinct components 
of Qq. We may assume that Aq is a very general point. On the 4-dimensional 
quadric Qt,t 0; can find an irreducible conic c* C Qt containing both At 
and Bt. The limit cq C Qq cannot be irreducible because it contains Aq and 
Bq lying on different components of Qq. Thus cq must be the union of two 
irreducible curves of degree 1 with respect to / by the assumption (b). Fixing 
{At I t G A} and varying {Bt \ t G A}, we get irreducible rational curves C 
of degree 1 through Aq which cover a component of Qq. Thus —Kz^ • G > 5 
by Lemma 1.4. Since Aq is very general. Lemma 1.3 says that C is the limit 
of a family of curves of degree 1 on Z*, a contradiction to Lemma 1.1. □ 

Lemma 1.6. The hypersurfaces Q, Q' which are closures of two generic leaves 
of Qq do not intersect. 
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Proof. Let Qo be as in Lemma 1.5. Suppose Bq G Qq is contained in the 
closure of any other leaf. Pick a generic point Aq G Qo and local holomorphic 
sections of Z given by At, Bt G Qt, extending Aq and Bq. The set of irreducible 
conics through At and Bt cover Qt for t 0. We claim the same is true for 
t = 0. Otherwise Qo is covered by a family of curves of degree 1 through Aq or 
by a family of curves of degree 1 through Bq by the assumption (b). A generic 
member C of this family passes through a very general point. Thus C is free 
and its deformation fixing one point cover Qo, giving —Kzq • O > 5 by Lemma 
1.4., which leads to a contradiction as in the proof of Lemma 1.5. It follows 
that we get an irreducible conic c through Bq on Qo which is not contained in 
a generic Q' yf Qo, while it intersects Q' at Bq. Thus Qo • c = Q' • c > 0. But c 
is the limit of conics lying on Qt which must have zero intersection with Qt, 
a contradiction. □ 

Since the closures of two general leaves of Qo are linearly equivalent divi- 
sors on Zq, Lemma 1.6 implies that the linear system defined by these divisors 
is base-point free. In other words, the leaves of Qo give a base-point free pencil 
on Zq, defining a morphism Zo — > Pi. A generic leaf Qo must be projective 
and smooth. It is a limit of the quadrics Qt, thus Qo itself is a 4-dimensional 
quadric. So we have a morphism : 2 — > Z\ x Pi whose fibers are Q4 except 
possibly at finitely many points in {0} x Pi. 

Lemma 1.7. Every fiber of Zq Pi has a generically reduced component. 

Proof. We can choose a family of curves Ct C Zt of degree 1 with respect to 
f such that it is a section of Zt Pi. The limit Co must be irreducible of 
degree 1 by the assumption (a) and a section of Zq — > Pi. Since Q* • C* = 1 
for t y^ 0, Co has also intersection number 1 with any fiber of Zq ^ Pi. Since 
Co is not contained in any fiber, this implies that any fiber must be reduced 
at the point of intersection with Co. □ 

We conclude that every fiber of : Z ^ Z\ x Pi is Q4 by the following. 

Lemma 1.8. Let n : Y ^ M be a flat morphism from a complex manifold Y 
over a 2-dimensional complex ballM with center 0 G B. Suppose that every fiber 
i^~^{b) over b gM is biholomorphic to a smooth quadric Q. If the fiber 
has a generically reduced component, then it is also biholomorphic to Q. 

Proof. Since the statement is local at 0 G B, we will shrink the 2-dimensional 
ball whenever necessary without mentioning it explicitly. Take a local section 
of v slicing the fiber at a generic point of the generically reduced 

component. Choose a tubular neighborhood fl of this section so that v\q : 
C ^ B is of maximal rank everywhere. Let fib be the fiber over b G B which 
is a complex manifold. By assumption, fib,b yf 0, is an open subset in Q 
and is equipped with a flat holomorphic conformal structure. This conformal 
structure can be extended to a flat conformal structure on fig by Hartogs (cf. 
[HMl], Proposition 1). Thus we have a holomorphic immersion (p : fi ^ Q xB 
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which preserves the conformal structure. Either by [HMl], Proposition 3 or 
by [HM3], Theorem 1.2, we can extend cp\n-ng to a biholomorphic map 

<l> : r - ^ Q X (B - {0}). 

Choose any non- vanishing vector field w on B and lift it to w on Q x B. 
The pull-back <!>*w defines a vector field on F — lifting co. By Hartogs, 

we have an extension w of to F. Then w is a lifting of w to F. Thus any 
vector field on B can be lifted to a vector field on F, which implies that v is 
a locally trivial family. □ 

It follows that ly : Z ^ ¥i X A is the Grassmannian bundle G(2,1F) of 
a vector bundle T of rank 4 on Pi x A. For t ^ 0, we know that IF* := 
= £* = O (B To complete the proof of Proposition 1.2, it 

suffices to show that 1 F° = O 0 

Let pr : Pi X Z\ — > Z\ be the projection to the second factor. Let u be a non- 
vanishing section of the invertible sheaf pr*lF and let ct* be the corresponding 
section of IF* on Pi. For t yf 0, the section cr* of IF* is nowhere vanishing 
on Pi. If has a zero, we can easily get a contradiction to the assumption 
(a). Thus (7° is nowhere vanishing and a defines a trivial line subbundle O 
of T with locally free quotient Q = T jO. Let fj* be the restriction of Q on 
Pi X {t}. Then Q* = 0(— 1)^ for all t yf 0. Applying the same argument using 
the assumption (a) topr*(^ 0 (!l(l)), we see that It follows that 

= O (B This completes the proof of Proposition 1.2. 

Remark. Lemma 1.8 works when we replace the hyperquadric Q by any irre- 
ducible Hermitian symmetric space. The same proof works if the holomorphic 
conformal structure is replaced by the holomorphic structure modelled on an 
irreducible Hermitian symmetric space of rank > 2 (see, e.g., [HMl] Section 
1 for definition). 



2 Z As a Projective Variety 

The Pliicker line bundle ^ on F is very ample, defining an embedding of Z 
into PiL°(F, ^)*. Note that 

2 

=H-°(Pi, 7?4) = ijO(Pi,/\F) ^7J°(Pi, 0(1)3 0 0(2)3) 

is 15-dimensional. Thus Z C P 14 . The restriction of this embedding to S' C F 
is equivalent to the Segre embedding of S = P 2 x Pi. In fact, the restriction 
map iL°(F, ^) ^ is surjective and 



H"(S,0 = i^°(Pi,x4) = V) = i?°(Pi, 0(1)3) 
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is 6-dimensional. From now on, we will regard Z as a projective subvariety 
of Pi 4 under this embedding. In this section, we will study some geometric 
properties of tangent lines of Z. 

Let us fix a 2-dimensional vector space W and a 3-dimensional vector space 
V. Let us identify our base curve Pi with ¥W and the hyperplane line bundle 
0(1) with the dual tautological line bundle h on FW such that H^(FW, h) = 
W* . Also make an identification of S with PV* where V = V* h, so that the 
subspace of H°{Z,^)* spanned by S' C PiL°(Z, ^)* is canonically identified 
with V 0 W. Under these identifications, 

iL°(S, 0 = H°{FV (g)h*,0 = i?°(PIU, V*Z)h) = V*Z) W* 

in a canonical manner. The kernel of the restriction map H^{Z, — > H^{S, 

can be naturally identified with the subspace of 

2 

H^{Z,^) = H°{FW,/\S) 

consisting of sections of the subbundle f\^ V C f\^ S on ¥W . So the kernel is 

2 2 2 2 
H^{FW,f\V) = H^{FW, l\{y*®h)) = H^{FW, f\V*®h'^) = 

This gives the natural exact sequence 

2 

0 — >V<ZW — > H°{Z, ^)* — > f\V<Z S'^W — > 0. 
Summarizing, 

Proposition 2.1. Once we make an identification o/Pi with FW and S with 
FV X FW then the subspace of H^{Z,^)* spanned by S C FH^{Z,^)* is cano- 
nically identified with V ®W and the quotient space is canonically identified 
with }\VZ) S'^W. 

To study the projective geometry of Z C FH^{Z,^)*, it is convenient to 
fix a splitting of 

0 — >V — >£ — >0 — >0 

given by a trivial line subbundle A <Z £ complementary to V. Then 

2 2 

f\£ = (/\V)©(V® A). 

Thus H^{Z,(f) has splitting 

2 2 

H^{Z,(,)=H^{FW,f\V)®H^(FW,V®A) = {f\V* ® S^W*)®{V* ®W*). 
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To simplify the notation, set 

2 

U = H°{Z,^y, Ui :=V<»W, U2 := f\V®S^W 

and identify U := Ui 0 1/2 by the above splitting. We denote hy Z C U the 
affine cone defining Z . Then 

Z = (t'iA-U2)0w^) & U \w & W and v,v\,V2 G V with wAwi Aw2 = 0 }. 

Now we use the symmetry of Z. The vector spaces U, U\ and U2 have natural 
SL(H) X SL(W)-module structure. As an SL(H)-module, /\^ V is isomorphic 
to V*. To simplify the notation, we will make the identification 

U 2 = V*Z) s^w. 

This identification is uniquely defined up to a multiplicative constant. We will 
fix a choice of such an identification. Then the affine cones of S and Z can be 
written as 

S = {v ® w &Ui \ V &V,w &W} 

Z = {{v ® w,v* ® wy \ w £ W,v £ V,v* £ V* ,< V* ,v >= Q} 
where < v* ,v > denotes the evaluation of v* at v. Let 

R-.= {v* €U2 \v £ V*,w€ W} 

and R C Pf72 be the corresponding projective subvariety. The varieties S C 
Pf7i, R C FU2 and Z C FU are invariant under the SL(fA) x SL(W)-action on 
FU. 

Remark. Here and in what follows, whenever we identify an irreducible 
SL(H)-module or an irreducible SL(W)-module with another, the identifi- 
cation is unique up to a choice of multiplicative constant by Schur lemma. We 
will implicitly make a fixed choice of the identification. 

The projective geometry of Z C FU we are interested in is about the linear 
span of the variety of tangent lines of Z in /\^ U. 

Lemma 2.2. The tangent lines to S, regarded as points of P(/\^C/i) by 
Pliicker map, span /\^ U\ . 

Proof. The irreducible iL-module decomposition of f\^ U\ is 
22 2 

f\iy ®w) = {f\v® S^W) 0 {S^V 0 f\ W). 

Consider a plane in S of the form 



C(rii 0 w) 0 C(v2 0 w) 
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for some v\ ^ vi ^ V and w & W. This corresponds to the element (t;i A 
V 2 ) ® {w Qw) in fy V ® S"^W. On the other hand, a plane in S of the form 
{v ® w\) A {v ® W2) for some v € V and w\ ^ W2 & W corresponds to the 
element {vQv)^{wiAw2) in W. Thus there are points corresponding 

to tangent lines to S in both irreducible SL(fA) x SL(lT)-components of /\^ U\. 
Since the linear span of the tangent lines to S in /\^ Ui is an SL(R) x SL(fT)- 
invariant subspace, it must be the whole oi U\. □ 

Lemma 2.3. The linear span of the tangent lines to R in f\^ U 2 contains 
the unique subspace of codimension 3 in /\^ U 2 with SL(fA) x SL{W)-module 
structure (A^ O S'^W) 0 {S^V* ® /\^{S^W)). 

Proof. The irreducible SL(R) x SL(fT)-module decomposition of A^ U 2 is 



/\(y*0S'2fT) = [/\R*0S'A5'2fL) © S'V* 0/\(S'2fT) 

2 2 2 
= /\V* ® (^/\V* ® © (s'2'1/* © /\(5'2fT)) 



using the SL(fT)-module decomposition S'^{S‘^W) = C© S'^W . A plane in R 
of the form C(r)4 © + C(v2 © uf^) for some v\ ^ V2 & V* and w & W 

corresponds to the element (v* A w|) © © w"^) in V* © S'^W. Consider 

the family of secant lines of R through the point [v* © wl] and the family of 
points [w*©(ici + tiC2)^], where 0 A ^ G C and w\ ^ W2 & W. They correspond 
to the elements 



2 

(v* © wf) A (v* © (wi + tw 2 Y) G A(r- ®S^W). 



As t approaches to 0, this family of secant lines converges to the tangent line 



,, iv ® w\) A iv © (wi + tW 2 Y) 

lim 

t^o t 



2(v* © V*) © {wl A wl) 



which is contained in S^V* © /\^{S'^W). Since the linear span of the tangent 
lines to R is SL(C) x SL(lT)-invariant in A U2, the proof of Lemma 2.3 is 
complete. □ 



Let us recall the SL(lT)-module decomposition 

w ® s‘^w = w ® S^W 



given by the symmetrization W ® S'^W S^W and its two-dimensional 
kernel. Also recall the SL(C)-module decomposition 

R © C* = adv © C 
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where ady corresponds to the traceless endomorphisms and C corresponds to 
the homothety endomorphisms, under the identification V 0 V* = End(l^). 

So we have the equivalence of SL(E) x SL(lE)-modules 

{V®W)^ {V* ® S'^W) = (H (g) hh) 0 (V* (g S'^W) 

= {V ®V*) ® {W ® S'^W) 

= (ady (g hh) 0 (ady 0 S^W) 0 IE © S^W. 

Proposition 2 . 4 . Let S C /\^ U be the linear span of the tangent lines to Z. 
Then in the SL(E) x SL{W)-module decomposition of U 

2 2 2 
f\iUi 0 [/a) = /\ C/i 0 /\ c/2 0 (C/i 0 C/ 2 ) 

2 2 

= A ® f\(y* ® 0 [{V 0 IE) A (E* 0 S'^W)] 

2 2 2 2 
= f\Ui®[f\V* ® {f\V* ® S^W) 0 (S'^E* 0 A('S'^^)) 

0 [(ady 0 IE) 0 (ady 0 S^W) 0 IE 0 S^W] 

U contains 

22 2 

A [(A ^*®'5'4Vh)0(S'2E*0A(<S'^W"))j 0[(ady0lE)0(ady0S'3tE)0S'3lE]. 

Proof. We have already seen in Lemma 2.2. and Lemma 2.3. that f\^ U\, E*0 

S'^W, S'^V* 0 /\^(5'^1E) are contained in S. 

Choose V\,V 2 G E and v\,V 2 G V* such that 

< Vi,Vi >= 0, < Uy U2 > + < ^'2! ^1 >= 0) < Uy U2 > — < U2, ui >7/ 0. 

Then for any non-zero element w G IE, 

(vi®w+Vi®w^) G Z = {(v®w, v*®w^); w G IE, u G E, v* G E*, < v*,v >= 0}. 
The plane 

C(ui 0 W 0 Vj 0 w'^) + C{v2 ®W + V2® w^) C U 
is tangent to Z. In fact, the line 

{(ui 0 ru 0 0 w^) 0 \{v2 0 rc 0 U 2 0 n?)] A G C} 

= {(ui 0 \v2) 0 (ft 0 AU 2 ) 0 rc^); A G C} 
is tangent to Z because 

< («]■ 0 Au2,Wi 0 Au2 >= A^ < V2,V2 > 
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contains no linear term in A. In /\^ U , this plane is represented by the element 
(wi 0 tu -I- Wi (8> w'^) f\{v2®W + V2® w^) 

= (vi A W 2 ) 0w^ + (v^Av2)0w^ + (vi 0w) A (v2 0 w^) — (v2 0w) A (t;4 

The first two terms on the right hand side are in /\^ V 0 S'^W and /\^ V* 0 
S'^W. Upon identification of U\ A U 2 with U\ 0 U 2 , the last two terms corre- 
sponds to 

(wi 0 V 2 ) 0w^ — {V2 0 Vi) 0W^ = {vi 0V2 — V2 0 «! ) 0 . 

But this element of {V* 0 V) 0 S^W = (ady -|- Cldy) 0 S^W does not 
lie in ady 0 S^W because < Wi,W 2 > — < t’ 2 )'*^! 0- does it lie in 

C Idy 0 IT because vi0V2~V2 0 has rank 2 as an endomorphism of V. 
Since this element is contained in S, we see that both ady 0 S^W and S^W 
are contained in E from the SL(U) x SL(IU)-invariance. 

Now fix V € U and v* G V* with < v* ,v >= 0 and choose two independent 
vectors wi,W 2 G W. Consider the point v0wi + v* 0wl and a family of points 

{[r; (g) (wi -I- tw2) -I- V* (g {wi + ^ 2 )^]; f G C} 

in Z. The secant lines 

[ri (g -I- V* (g w\] A [v (g (ici -I- tw 2 ) + v*0 {wi + tw 2 )‘^] 
converges to the tangent line 

(ri (g rci -|- V* (g wl) A {v 0W2 + “2v* 0 ^ 1 ^ 2 ) 

= 2{v 0 wi) A {v* 0 W 1 W 2 ) — (v 0 W 2 ) A {v* 0 wl) 

+ v"^ 0 {wi A W 2 ) + 2(v*)^ (g {wf A wiW2)- 

The last two terms on the right hand side lie in S'^V 0 /\^ W C f\^ U\ and 
S'^V* 0 f\^{S'^W) respectively. Upon identifying U\ A U 2 with U\ 0 U 2 , the 
first two terms correspond to 

2{v0V*)0{wi0WiW2) — {v0V*)0{w20wl) = {v0V*)0{2wi0WiW2 — W20wl). 

This element of S lies in ady 0 {W 0 S'^W) = ady 0 {W 0 S'^IU) because 
< V* ,v >= 0. Since 2wi 0 W 1 W 2 — W 2 0wf is not contained in S'^W , it must 
have a component in ady 0 W. It follows that ady 0 lU is contained in S. 
□ 



3 Z As the Variety Of Minimal Rational Tangents 
For G/P 



Let us recall some general facts before we look at our homogeneous variety 
G/P (cf. [HMl], Section 2, [HM3], Section 1). Let X be a Fano manifold 
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of Picard number 1 and x £ X he & generic point. Let K-x be the union of 
all components of the normalized Chow space of rational curves of minimal 
degree through x. It has finitely many components and each of them is a 
smooth projective variety. If the anti-canonical degree of members of K-x is 
p + 2, then K-x is of pure dimension p, and for a generic member C of any 
component of Kx, 



T{X)\c = 0(2) 0 [0(1)]P © 

Define the tangent map Tx ■ ICx ^ FTx{X) by assigning the tangent vector at 
X to each member of ICx which is smooth at x. By [Ke], this can be extended 
to a morphism which is finite over its image. The image is denoted by Cx 
and called the variety of minimal rational tangents at x. Suppose X is 
embedded in some projective space P m and a minimal rational curve through 
a generic point cc is a line in P^r. Since lines through a; in Pv are determined 
by their tangent vectors at x, Tx is an embedding. 

We need to recall some definitions in the theory of differential systems 
([Ya]). Given a distribution D on a complex manifold X, define the weak 
derived system D^, k > 1, inductively by 

= D, 

Dk ^ j^k-i ^ 

For a generic point x G X in a neighborhood of which D^’s are subbundles of 
T{X), we define the symbol algebra of D at x as the graded nilpotent Lie 
algebra D], + D^/ D], + ■ ■ ■ + where r is chosen so that = D^. 

This integer r is called the depth of the system. 

When X is a Fano manifold of Picard number 1, let Wx C Tx{X) be the 
linear span of Cx at a generic point x G X and W be the distribution defined 
by hVx’s on a Zariski open subset of X. The distribution W has the following 
two properties. 

Proposition 3.1. ([HMl], Proposition 10) For any plane A C Wx corre- 
sponding to a tangent line to the smooth locus ofCx, there exists a local ana- 
lytic integral surface of the distribution W which contains x as a smooth point 
and has A as its tangent space at x. In particular, the Frobenius bracket tensor 
[ , ]x : A.'^yVx Tx{X) /Wx at a generic point x G X annihilates any element 
corresponding to tangent lines to the smooth locus ofCx- 

Proposition 3.2. ([HM4], Proposition 4) At a generic point x G X , the sym- 
bol algebra ofW has dimension n = dim(X). 

Now we introduce our homogeneous variety G / P. Let us start with the Lie 
algebra part. This is a special case of [HM2] Section 2. Let g be the complex 
simple Lie algebras of type F 4 . Let f) be a Cartan subalgebra of g and <F 
be the corresponding system of roots. We choose a system of simple roots 
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{cti, «2, CT3, <24}. Here the numeration of simple roots are made such that «i 
and «2 are short roots and the maximal root is 

2cri -t“ 4 ct 2 “t“ 3 ct 3 -t- 2cr4. 

We will be interested in the maximal parabolic subalgebra p of g corresponding 
to the simple root 02 - Let us recall the definition of p. For —4 < k < k, we 
define (k>k as the set of all roots ^ith m2 = k. For a G <?, let be 

the corresponding root space. Define 

00 = f) ® 0QJ 

flfc = 0 fla, 0. 

Then the parabolic subalgebra p can be defined as 

P = 00 ® 0-1 ® 0-2 ® 0-3 ® 0-4- 

Define 

6 = 00, 

U = 0-1 ® 0-2 ® 0-3 ® 0-4- 

Then p = u -I- 6 is a Levi decomposition of p. It is easy to check that the 
semi-simple part of 6 is isomorphic to 5I2 ® SI3. 

Now let G be a simply connected complex Lie group with Lie algebra 0 
and P C G he the subgroup with Lie algebra p. The homogeneous space G/P 
is a projective variety of dimension 20 with Pic(G/P) = ZL for an ample 
generator L and c\{G/P) = 7L. Let o G G/P be the base point. The tangent 
space To{G/P) is canonically isomorphic to g/p. The isotropy representation 
of P on To{G/P) is equivalent to the adjoint representation of P on g/p. The 
choice of a Levi factor i as above gives a reductive subgroup K C P with Lie 
algebra 6. As a complex Lie group, K is isogenous to C* x SL(H) x SL(bF) 
where V and W are as in Section 2 . After such a choice of Levi factor, we 
have the identification 

To{G/P) = g/p = 01 +02 + 03 + 04 

which is the decomposition into irreducible iF-modules. In fact, this is the 
weight space decomposition of the action of the subgroup of K corresponding 
to C*: A G C* acts as the scalar multiplication by A* on g^. This decomposi- 
tion depends on the choice of the Levi factor. But the filtration on To{G/P) 
given by 



Di,o 01 + • • • + 0i, 

Dl,o C D2,o C D3,o C +>4,0 = To{G/P) 
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is naturally defined. This filtration induces natural subbundles of the tangent 
bundle 

DiCD2CD3CD4 = T{G/P). 

In fact, this is the weak derived system of the distribution Di. Let Hi C Pgi 
be the highest weight variety with respect to the iL-action. Then the following 
is well-known. 

Proposition 3.3. ([HM2], Proposition 5) For any a G PTo(G/P), the clo- 
sure of the P-orbit of a under the isotropy action contains H\. For any 
a G VTo{G/P) — Pgi, the closure of the P-orbit of a contains H 2 - 

The line bundle L is very ample, giving an embedding GfP G P 271 . More- 
over G/P is covered by lines of P 271 . Let JCx be the subvariety consisting of 
all lines passing through x G G/P. The tangent morphism Tx ■ ICx ^ Cx C 
FTx{G/P) is an embedding. From c\{X) = 7L, Cx is 5-dimensional. By the 
homogeneity, the structure of Cx as a subvariety of FTx{G/P) does not de- 
pend on X. At the base point o G G/P, Co is invariant under the isotropy 
action of P on ¥To{G / P) . In particular, it is invariant under the AT-action for 
any choice of the Levi factor K C P. The structure of 0 i as an irreducible 
AT-module can be easily read off from the basic theory of roots: 



01 = P 0 VF, 

2 

Q2 = /\VG)S^W, 

03 = IP, 

04 = p 

Thus as AT-modules, D\ o = U\ and 1 ) 2,0 = U . Under this identification, we 
aim to show that Cx is equivalent to Z . The following characterization of Z is 
useful. 

Proposition 3.4. The variety Z is the only K -invariant projective subvariety 
of dimension < 5 in PU which intersects both S and R. 

Proof. Viewing elements of Ui as a linear map from V to W, we can list all 
the AT-orbits in PUi: 

{Elements of rank 1} of dimension 3, 

{Elements of rank 2} of dimension 5. 

Similarly, viewing elements of U 2 as linear maps from V* to S'^W, we can 
list all AT-orbits PU 2 . Let Q := {[rc^] G PS'^W;w G IP} be the conic curve in 
the plan PS'^W . Then there are exactly five AT-orbits in PU 2 '. 

{Elements of rank 1 with images contained in Q} of dimension 3, 
{Elements of rank 1 with images not contained in Q} of dimension 4, 
{Elements of rank 2 with images tangent to Q} of dimension 6, 
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{Elements of rank 2 with images not tangent to Q} of dimension 7, 
{Elements of rank 3} of dimension 8. 

Let Z' be an irreducible iL-invariant projective subvariety of PU which inter- 
sects both S and R. Then Z' is contained in neither TUi nor TU 2 - Thus Z' 
contains a point [(^ 1 ,^ 2 )] G P(C/i + U 2 ) with ui yf 0 and U 2 yf 0. Recall that 
X G C* C K acts as the multiplication by A on ui and as the multiplication 
by on U 2 - Thus the closure of the C* orbit of the point [(mi,M 2 )] contains 
both [mi] G FUi and [^ 2 ] G PC/ 2 - Z' contains the iL-orbits of [ui] and [^ 2 ]. 
This implies that the RT-orbits of [ui] and [^ 2 ] must have dimension < 4. The 
above dimension counting implies that ui is in S and U 2 lies in the affine cone 
of the closure of the 4-dimensional orbit in P[/ 2 - In other words, u\ = v ® w 
and U 2 = V* ® s for some v G V,v* G V*,w G W and s G S'^W. For fixed 
w and s, the SL(E)-orbit of [(mi,W 2 )] has dimension 5 unless < v*,v >= 0. 
For fixed v* and v, the SL(kE)-orbit of [(mi,W 2 )] has dimension > 2 unless s 
is proportional to w“^. Thus the RT-orbit of [(mi, M 2 )] has dimension > 5 unless 
[(mi,M 2 )] lies on Z. We conclude that Z' = Z. □ 

Proposition 3.5. The variety of minimal rational tangents Co C PTo(G/P) 
is irreducible and contained in P-D 2 . 0 - Under the identification of D 2 ^o with U 
as K -modules, Co corresponds to Z. In particular, the normalized Chow space 
ICo is biholomorphic to Z. 

Proof. Note that the irreducibility is not entirely obvious, because a priori 
there may exist more than one family of lines on G/P. We know that Co 
is smooth and of pure dimension 5. We claim that Co does not contain a 
component inside PI?i^o. Suppose there exists a component inside PTAi^o- Then 
the component must be equal to PiAi^o by considering dimensions. This implies 
that there is no other component from the smoothness of Co and Proposition 
3.3. Then D\ agrees with the distribution W spanned by the variety of minimal 
rational tangents. By Proposition 3.1, D\ must be integrable, a contradiction 
to Proposition 3.2. Thus no component of Co is contained in PI?i o and each 
component C' of Co must contain both Hi = S and H 2 = R hy Proposition 
3.3. Then C' nPiA 2 ,o is a RT-invariant projective subvariety in PC/ of dimension 
< 5 which intersects both S and R. It follows that Co is contained in P/A 2 ,o and 
is isomorphic to Z C PC/ as a projective variety, by Proposition 3.4. The last 
statement of Proposition 3.5. follows from the fact that the tangent morphism 
Tx is an embedding. □ 

Proposition 3.6. In the statement of Proposition 2-4, XJ is exactly the sub- 
space of f\^ U corresponding to the factors isomorphic to 

22 2 

A ^ 1 ® [(A I"*«'‘5'4W^)0(S'V*(g)A(*S'^W^))] ©[(ady(g)W)0(ady(g)5'3W)©5'3W]. 

In particular, /\^ U /E =W ®V . 
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Proof. When we make an identification of D 2.0 with U, S C f\^ £> 2,0 is an- 
nihilated by the Lie bracket of the symbol algebra of £>2 at o by Proposition 
3.1. If S is larger, {D 2 Y / D 2 must have dimension < 5 = dim(W 0 V), where 
(£> 2 )^ denotes the weak derived system of the distribution £> 2 . But the Lie 
bracket for the symbol algebra must be the one inherited from the Lie bracket 
of the Lie algebra g, thus { 02 )'^ / D 2 = 0 s 0 04 is of dimension 5. □ 



4 Proof Of Main Theorem 

Let 7 T : df ^ Z\ be as in Main Theorem. It is easy to see Pic(df) = Pic(G/P) = 
Pic(Xo). Let £ be an ample generator of Pic(A’). Then ci(Xo) = 1C. Xq is a 
Fano manifold of Picard number 1. 

Proposition 4.1. Let x € Xq be a generic point and Kx he the normalized 
Chow variety of rational curves of degree 1 with respect to C. Then ICx = Z. 

Proof. Let {xt & Xt\ he a , section of tt with xq = x. Let 

tp : Z = UteAlCxt 

be the family of normalized Chow spaces of minimal rational curves through 
Xt. Then ip is a smooth projective morphism by the same proof as Proposition 
4 in [HMl]. We know ip~^{f) 0 Z, t 0, by Proposition 3.5. The tangent 
morphisms Tx^ ■ ICxt —>■ Cxt C ¥Tx^.{Xt) form a fiat family of finite morphisms. 
By pulling back the hyperplane line bundle oi¥Tx^{Xt), we get a line bundle 
C on Z whose restriction to ip~^{t) is isomorphic to the Pliicker line bundle 
f on Z. It follows that by Proposition 1.2. and the next lemma 

whose proof is the same as those of Lemma 1 and Lemma 2 in [HM4] . Instead 
of repeating the proof, let us just mention that it is a direct consequence of 
the fact that the curves Ct corresponds to surfaces in Xt of degree 1 for (a) 
and of degree 2 for (b) with respect to the ample line bundle C. □ 

Lemma 4.2. Let xp> : Z ^ A he the family of normalized Chow spaces of 
minimal rational curves through generic points x± of Xt and f be the line 
bundle on Z as defined above. Then for any flat family of curves {Ct C Zt \ 
t G A}, 

(a) if Ct has degree 1 with respect to C, the limit curve Co is irreducible, 
and 

(b) if Ct has degree 2 with respect to (, then the limit curve Cq is either 
irreducible or a union of two irreducible curves of degree 1 with respect to f. 

Let D*,l < i < 4,t 0, be the distributions on Xt induced by the 

distributions Di on G/P under the biholomorphism Xt = GjP . Let be 

the limit distribution which is well-defined on a Zariski open subset of Xq. 
On a Zariski open subset of Xq, we have another distribution W defined as 
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the linear span of the variety of minimal rational tangents Cx as x varies 
over generic points of X. Recall that on G/P = Xt,t yf 0, the distribution 
defined by the linear span of the variety of minimal rational tangents is D 2 
by Proposition 3.5. The key ingredient in the proof of Main Theorem is the 
following. 

Proposition 4.3. On a Zariski open subset of Xq, the two distributions W 
and D 2 agree and the tangent morphism Tx '■ Z = ICx PH’s at a generic 
X € Xq is the embedding defined by the complete linear system |^| on Z. In 
particular, the variety of minimal rational tangents Cx C PH’s is isomorphic 
to Z C fU as projective varieties. 

For the proof of Proposition 4.3., we need the following algebraic result, 
which is an analogue of [HM4] Proposition 6 in our setting. 

Lemma 4.4. Let n = ® graded Lie algebra generated by n\ = U 

so that the kernel of the Lie bracket [ , ] : >^1 ^ ^2 is exactly X C /\^ U 

defined in Proposition 3.6. Then = 0 for i > 3. 

Proof. We will check this explicitly by brute force. The roots d>i,l < i < 4 
defining can be explicitly written as follows ([HM2] p. 226), where we denote 
a root aa\ + ba 2 + 003 -I- da^ by abed: 

^>4 = { 0100 , 0110 , 0111 , 1100 , 1110 , 1111 }, 

^>2 = { 0210 , 0211 , 0221 , 1210 , 1211 , 1221 , 2210 , 2211 , 2221 }, 

<?3 = {1321,2321}, 

^>4 = {2421,2431,2432}. 

By the assumption, we can identify n\ = U with gi -|- g2 and ti2 = gs -I- g4 as 
vector spaces. We choose a basis of ni corresponding to root vectors in gi -f g2 
and a basis of U2 corresponding to root vectors in g3-l-g4. By abuse of notation, 
we will denote a root vector corresponding to the root aai -I- &«2 + ca^ + da^ 
by abed. In other words, the basis of U can be written as 

{abed e<PiU ^2} 

and the basis of U2 can be written as 

{abed G ^3 U ^4}. 

In terms of these bases, the Lie bracket [, ] : ^2 behaves like the 

Lie bracket for root vectors in the Lie algebra g up to non-zero multiplicative 
constants, except that [gi,gi] = 0 in n. In other words, we have the following 
identities in n up to non-zero multiplicative constants: 

[abed,a'b'e'd'] = 0 for abed,a'b'e'd' G if {a+ a'){b+b'){e+ c'){d+ d') 

do not appear in <^3 U ^4, 

1321 = [0100,1221] = [0110,1211] = [0111,1210] = [1100,0221] = 

[ 1110 , 0211 ] = [ 1111 , 0210 ], 
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2321 = [0100,2221] = [0110,2211] = [0111,2210] = [1100,1221] = 

[ 1110 , 1211 ] = [ 1111 , 1210 ], 

2421 = [0210, 2211] = [0211, 2210] = [1210, 1211], 

2431 = [0210, 2221] = [0221, 2210] = [1210, 1221], 

2432 = [0211, 2221] = [0221, 2211] = [1211, 1221], 

To prove Lemma 4.4, it suffices to show that the following brackets vanish 
in the Lie algebra n when we make the identification of vector spaces ni = 
01 + 02 and U 2 = 03 + 04 : 



[ 01 , 04 ] , [ 02 , 03 ]; [ 02 , 04 ] , [ 03 , 03 ], [ 04 , 04 ] , [ 03 , 04 ] , [ 01 , 03 ]- 

Among these the vanishing of the first 6 brackets follows from the above 
formulae. Let us check explicitly. 

[ 01 , 04 ] = 0 

[0100,2421] = [0100, [0210,2211]] = 0, 

[0100, 2431] = [0100, [0221, 2210]] = 0, 

[0100, 2432] = [0100, [0221, 2211]] = 0, 

[0110, 2421] = [0110, [0211, 2210]] = 0, 

[0110, 2431] = [0110, [0221, 2210]] = 0, 

[0110, 2432] = [0110, [0211, 2221]] = 0, 

[0111, 2421] = [0111, [0210, 2211]] = 0, 

[0111. 2431] = [0111, [0210, 2221]] = 0, 

[0111. 2432] = [0111, [0211, 2221]] = 0, 

[1100, 2421] = [1100, [0210, 2211]] = 0 
[1100, 2431] = [1100, [0210, 2221]] = 0, 

[1100, 2432] = [1100, [0211, 2221]] = 0, 

[1110, 2421] = [1110, [0210, 2211]] = 0, 

[1110.2431] = [1110, [0210,2221]] = 0, 

[1110, 2432] = [1110, [0221, 2211]] = 0, 

[1111, 2421] = [1111, [0211, 2210]] = 0, 

[1111, 2431] = [1111, [0221, 2210]] = 0, 

[1111. 2432] = [1111, [0221, 2211]] = 0. 

[ 02 , 03 ] = 0 

[0210. 1321] = [0210, [1100, 0221]] = 0, 

[0210, 2321] = [0210, [1100, 1221]] = 0, 

[0211. 1321] = [0211, [1100,0221]] = 0, 

[0211, 2321] = [0211, [1100, 1221]] = 0, 

[0221. 1321] = [0221, [1111,0210]] = 0, 

[0221, 2321] = [0221, [1111, 1210]] = 0, 

[1210. 1321] = [1210, [1100,0221]] = 0, 

[1210, 2321] = [1210, [0100, 2221]] = 0, 

[1211. 1321] = [1211, [1100,0221]] = 0, 

[1211, 2321] = [1211, [0100, 2221]] = 0, 

[1221. 1321] = [1221, [1111,0210]] = 0, 

[1221, 2321] = [1221, [0110, 2211]] = 0, 
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[2210. 1321] = [2210, [0100, 1221]] = 0, 

[2210. 2321] = [2210, [0100, 2221]] = 0, 

[2211. 1321] = [2211, [0100, 1221]] = 0, 

[2211, 2321] = [2211, [0100, 2221]] = 0, 

[2221. 1321] = [2221, [0111, 1210]] = 0, 

[2221, 2321] = [2221, [0111, 2210]] = 0. 

[02.04] = 0 

[0210.2421] = [0210, [1210, 1211]] = 0, 

[0210.2431] = [0210, [1210, 1221]] = 0, 

[0210. 2432] = [0210, [1211, 1221]] = 0, 

[0211, 2421] = [0211, [1210, 1211]] = 0, 

[0211, 2431] = [0211, [1210, 1221]] = 0, 

[0211, 2432] = [0211, [1211, 1221]] = 0, 

[0221, 2421] = [0221, [1210, 1211]] = 0, 

[0221, 2431] = [0221, [1210, 1221]] = 0, 

[0221, 2432] = [0221, [1211, 1221]] = 0, 

[1210, 2421] = [1210, [0210, 2211]] = 0, 

[1210, 2431] = [1210, [0210, 2221]] = 0, 

[1210, 2432] = [1210, [0211, 2221]] = 0, 

[1211, 2421] = [1211, [0210, 2211]] = 0, 

[1211. 2431] = [1211, [0210, 2221]] = 0, 

[1211. 2432] = [1211, [0211, 2221]] = 0, 

[1221. 2421] = [1221, [0210, 2211]] = 0, 

[1221, 2431] = [1221, [0210, 2221]] = 0, 

[1221, 2432] = [1221, [0211, 2221]] = 0, 

[2210, 2421] = [2210, [1210, 1211]] = 0, 

[2210, 2431] = [2210, [1210, 1221]] = 0, 

[2210, 2432] = [2210, [1211, 1221]] = 0, 

[2211, 2421] = [2211, [1210, 1211]] = 0, 

[2211, 2431] = [2211, [1210, 1221]] = 0, 

[2211, 2432] = [2211, [1211, 1221]] = 0, 

[2221, 2421] = [2221, [1210, 1211]] = 0, 

[2221, 2431] = [2221, [1210, 1221]] = 0, 

[2221.2432] = [2221, [1211, 1221]] = 0. 

[03.04] = 0 

[1321.2421] = [[0100, 1221], [0210,2211]] = 0, 

[1321.2431] = [[1100,0221], [0210,2221]] = 0, 
[1321, 2432] = [[1111, 0210], [1211, 1221]] = 0, 
[2321, 2421] = [[0100, 2221], [1210, 1211]] = 0, 
[2321, 2431] = [[0110, 2211], [1210, 1221]] = 0, 
[2321, 2432] = [[0111, 2210], [1211, 1221]] = 0. 

[03,0s] = 0 

[1321.2321] = [[1111,0210], [0111,2210]] = 0. 

[04.04] = 0 

[2421.2431] = [[0210,2211], [1210, 1221]] = 0, 
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[2421, 2432] = [[0210, 2211], [1211, 1221]] = 0, 

[2431, 2432] = [[0210, 2221], [1211, 1221]] = 0. 

It remains to check that [ 01 , 93 ] = 0. This does not follow directly from 
the above identities between the special bases, because it is not true in the 
Lie algebra g. Recall that under the identification (/\^ U) jS = 93 + 94 , the 
subspace 93 corresponds to the IL-component of the RT-module decomposition 
of U given in Proposition 2.4. Thus we can see [ 91 , 93 ] = 0 from Jacobi 
identity, once we establish the following claim : 

(Claim) The part corresponding to the factor Ui A W in U\ A (/\^ U) is 
generated by the vectors of the form uA{u' Au ) with uAu' G E and uAu G E. 

Let us prove the claim. For general choices of non-zero vectors v € V,v* € 
V* and wi ^ W 2 € W, the element (w®ici) A(w* of {V®W)A{V*®S'^W) 

has a component in IF-component of the decomposition 

(P O IT) A {V* ® S'^W) = (ady (g) IT) 0 (ady 0 S^W) 0 IT 0 S^W. 

Choose wi G T satisfying < v* >= 0 and a general ic G IT . Then the 
element 

(i;i ®w) A [( 1 ; 0 wi) A {v* 0 W 2 )] 
of U A {/\^ U) is of the form we want because 

2 

(vi 0 w) A ( 1 ; 0 ici) G l\^Ui C E and 
(wi 0 W 2 ) A {v* 0 W 2 ) Gady0(lT0S'^lT) C P. 

On the other hand, since w,wi,W 2 are chosen in a general manner, it has 
non-zero components in both irreducible RT-factors of (T 0 W) A IT = (T 0 
/\ IT) 0 (T 0 S'^IT). This proves the claim by RT-invariance and the proof of 
Lemma 4.4. is complete. □ 

Now we are ready to prove Proposition 4.3. 

Proof (of Proposition ^.3.). Let us continue to use the notation in the proof 
of Proposition 4.1. We can view the tangent morphisms Txt '■ K-xt f’Txt{Xt) 
as a family of finite morphisms Txt '■ Z ^ f’Tx-t{Xt). 

By Proposition 3.5., Tx^ ■ Z ^ f‘Tx^{Xt) has image inside fD^^xt 
embedding defined by the complete linear system |^| for all t yf 0. It follows 
that Txg '■ Z ^ FTxg{Xo) is a morphism into defined by a subsystem of 

1^1 . So Cx is isomorphic to the image of Z C FU under a projection U U' . 
This has the following implication on the symbol algebra of W at x. The 
symbol algebra of W at cc is a nilpotent graded Lie algebra to = tui 0 rti 2 0 • • • 
generated by toi = Wx- The Lie bracket [ , ] : /\^ tui — ^ ro 2 annihilates all 
tangent lines to Cx- Since Cx is a projection of Z, to is a quotient algebra of 
the nilpotent graded Lie algebra n = rii 0 • • • generated by U with the Lie 
bracket [ , ] : /\^ rii — > ri 2 determined by the subspace E G U spanned by 
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tangent lines to Z. But by Lemma 4.4., n = ni -I- U 2 and dim(n 2 ) = 5. Thus 
the symbol algebra to is just 

tDl -f tD2 

with dim(tU 2 ) < 5. Using Proposition 3.2., we conclude that dimWa, = 15 = 
U. Thus W = andr^ : Z ^ is the embedding given by the complete 
linear system |^|. □ 

Proposition 4.5. The symbol algebra of at a generic point of Xq is iso- 
morphic to that of Di on G/P. 

Proof. Let us denote by T>i the distribution on T defined outside a set of 
codimension > 2 which agrees with D* on each Xt,t G A. By Proposition 
4.3 there exists a subvariety E C Xq such that Cx C VT>2,x is isomorphic to 
Z C FU for each x G X — E. Let Sx GL Cx be the subvariety corresponding to 
the Schubert subvariety S C Z. Let 

5 := y 5 ,. 

xGX-E 

Then S X — E is a holomorphic fiber bundle with fiber biholomorphic to 
S. The distribution T>i is exactly the linear span of 5 in T(A’). 

Choose a neighborhood U C X of a generic point x € such that there 
exists a trivialization 

S\u^F{VZ)h*) xU. 

By Proposition 2.1, the choice of such a trivialization naturally induces a 
trivialization of the vector bundles 

Vi\u = {V®W)®Ou, 

2 

'D2lVi\u = {f\v<z S^W) ® Ou. 

By Proposition 3.6, this induces a trivialization of [T’i,T’2]/2^2 = 'Psl'F ’2 and 
[T>2,2?2]/2?3 = 'Dil'Ds of the type 

TC>s/TC>2\u = U ® Ou^ 

= V Ou- 

These trivializations are not canonically determined by that of S\u, but are 
determined once we have made uniform choices of the identifications of irre- 
ducible SL(U) and SL(IU) modules involved (cf. Remark in Section 1). Once 
we have made these trivializations and fixed bases for V and W, the symbol 
algebra of the weak derived system of T>i is completely determined by the 
structure coefficients of the Lie algebra, which are holomorphic functions on 
G. These holomorphic functions are constant onU — X^ because the structure 
coefficients are fixed constants on G/P. Thus they must be the same constant 
on ZY n X^. We conclude that the symbol algebra of the system generated by 
is isomorphic to that of the one generated by Uj, t yf 0. □ 
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Now we recall the following result of K. Yamaguchi. 

Proposition 4.6. Let X he a 20 -dimensional complex manifold with a diffe- 
rential system D'^ of rank 6 and depth 4 such that the symbol algebra of the 
weak derived system D'^,1 < i < 4, is isomorphic to that of the system D\ 
on G/P. Then there exists an open subset U C X and an open immersion 
Lp -.U ^ G/P such that under the differential dp : T{U) T{p{U)), 

dT{D'/u) = Alip(w) for each i = 1,2, 3, 4. 

K. Yamaguchi ([Ya], Proposition 5.5) showed that the obstructions to con- 
structing such an open immersion p always vanish identically. 

Now we can finish the proof of Main Theorem as in the last paragraph 
of [HM4]. Let U C Xq and p : U ^ G/P be the ones defined on our Yq 
by Proposition 4.5 and Proposition 4.6. From the upper-semi-continuity of 
h'^{Xt,T{Xt)), the Lie algebra aut(Yo) of infinitesimal automorphisms of Yq 
has dimension > dim(g). By Corollary 5.4 of [Ya], the Lie algebra of infinites- 
imal automorphisms of p{U) preserving D\ is isomorphic to g. Thus the Lie 
algebra of infinitesimal automorphisms of U preserving D\ is isomorphic to g. 
By considering dimensions, aut(Yo) = g and the isomorphism is induced by 
p. In particular, G acts on Yq with the isotropy subgroup at a generic point 
isomorphic to P, implying Yq = G/P. 
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Abstract. The general question behind this paper is the possibility of nonrational 
varieties V with rational symmetric powers. We extend known results and show 
Severi-Brauer varieties provide a counterexample. On the other hand, we show that 
unramified cohomology cannot be the means to find such an example. 



Introduction 

For the second author, this paper began with a question at the conference. 
The question was the following. Let U be a variety (over F). Suppose the 
symmetric power S"(V) is rational. Does this force V to be rational or even 
unirational? Recall that V is rational if the function field F(V) is rational, 
i.e., purely transcendental over F, and unirational if F(V) C L where L/ F is 
rational. 

In this generality, the answer was, in fact, known. Let U be a nonrational 
conic curve (so V has no rational points and is, therefore, not unirational). 
Since V C P^(F), the symmetric square is clearly rational since it is (bira- 
tionally) the variety of lines in P^. Of course, the map associates two points 
on the conic with the line between them. 

Such an easy argument suggests that the above fact can be generalized. 
A conic can also be thought of as the Severi-Brauer variety of a quaternion 
algebra. In this paper we consider Severi-Brauer varieties V of central simple 
algebras A/F. We show that the symmetric power S'"(U) is rational, if n is 
the degree of A. This variety was studied previously by Merkurjev [M]. We 
also give descriptions of the other symmetric powers of V. 

Our result can be viewed as partly known, though our proof is completely 
new as far as we know. One can show (it takes a bit of work) that S'"(U) as 
above is birational to the variety of maximal separable commutative subalge- 
bras of A, and therefore also to the variety of maximal tori of A*. This later 

* The first author is grateful for support under NSF grant DMS-9983726. 

** The second author is grateful for support under NSF grant DMS-9970213. 
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variety was shown to be rational in [C], [BS]. The first author, in a future 
paper, will explore the connection between other symmetric powers of V and 
subalgebras of A. 

Of course Severi-Brauer varieties are always rational over f if T" is alge- 
braically closed. Thus these varieties cannot provide an example in the case 
that is most interesting, namely, a nonrational V over an algebraically closed 
field such that a symmetric power 5'"(F) is rational. In the second section we 
show that this may be a challenging problem. One of the most useful ways 
of showing that a field is nonrational is to use unramified cohomology. In 
this section we show unramified cohomology can never be used to show V 
nonrational when S"(V) is rational. 

In this context it is useful to recall some weaker notions of rationality. 
If K/F is a field extension we say K is stably rational if there is a field 
L Z) K such that L/K and L/F are rational. This is related to the notion 
that K/F and K' / F are stably isomorphic if and only if there is an T D 
K, L Z) K' such that L/K and L/K' are rational. Finally, we say K/F is 
retract rational if the following holds. K is the field of fractions of an affine 
domain R (written K = q{R)) and there are F maps R F[xi , . . . , x„](l/s) 
and F[xi , . . . , a;„](l/s) ^ R with R F[xi , . . . , a;„](l/s) ^ R the identity. 
Here F[xi, . . . , a;„](l/s) is the polynomial ring F[xi, . . . ,Xn] localized at a 
nonzero s G F[xi, . . . ,Xn]- Of course we say a variety V/F is rational, or 
stably rational, or retract rational, if F{V)/F is. We say varieties V/F, V /F 
are stably isomorphic is the same is true of F{V)/F and F{V')/F. As a final 
bit of notation, if AT is a field, let Kg denote the separable closure of K. 

It is typical to consider the symmetric product as an operation on varieties, 
but for our purposes it is best to think about fields. Suppose K/F is a, regular 
field extension. Then AT" = K®p...®pK is a domain with field of fractions 
q{K'"). There is an obvious action of the symmetric group on AT" and 
hence on q{K'"). We define the symmetric power S"{K/F) to be equal to the 
invariant field g(AT")‘^'* . It is very easy to see that if AT/F is rational, or stably 
rational, or retract rational, then S'"{K/F) is also. When F is clear we will 
write this field as S"{K). 



1 Severi-Brauer Varieties 

We begin with a construction more general than the Severi-Brauer varieties, 
or at least their fields of fractions. We consider the following construction, 
which we recall from, e.g., [LN]. Let G be a finite group, and M a lattice 
over G. Let L/F be a G extension of fields, and a G Extc(M, L*). Form 
the Laurent polynomial ring L[M] which can be also thought of as the group 
algebra of M over L. It is easy to see one can define an action of G on L[M] 
such that the extension 0 ^ L* ^ L[M]* M ^ Q corresponds to a. With 
this so called twisted G action, we write L[M] as La\M]. We can consider 
the invariant ring La[M\^ and its field of fractions La{M)'^ . Note that the 
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former is the affine ring of a principal homogeneous space over the torus with 
affine ring L[M\^ (untwisted action; i.e., a = 0). 

We want to compute the symmetric power of this field, and so we proceed 
as follows. Following the definition, q{La{M) . . . (8>f La{M)) (n times) is 
the field of fractions of the group ring 

with a twisted action by G © ... © G. The action by 5'„ can be defined via the 
usual action on L" and M" = M©. . .©M. The symmetric power 5 '"(Lq-(M)) 
is the field of fractions of the fixed ring of the above under the group W = 
(G © . . . © G) X S'n which is, of course, a wreath product. 

In L" there is a “multiplication” idempotent e such that eL" = L and in 
fact e(oi © ... © a„) maps to oi . . . a„. The stabilizer of e in bF is G® S'„ where 
G C G® ... © G is the diagonal. The index of G® S'„ in IF is |G|”“^ which is 
also the number of primitive idempotents in L". It follows that these primitive 
idempotents are all IF conjugates of e, and as a IF representation T"(M") 
is the induced representation Ind^05^ ((eL”)(M”)). In particular, projection 
onto (eL"))M") induces an isomorphism 

Define the a induced diagonal fd G ExtG©s„(Tf", T*) to be the element 
induced by inflation from (a © ... © a) G (ExtG(M, L*))” = ExtG(Tf”, L*). 
It is now clear that: 

Lemma 1.1. S^{La{M)^) = where [3 is the diagonal element 

induced by a. 

We require a special case of these twisted actions as follows. Let G be a 
finite group, H C G a, subgroup and L/F a G Galois extension. Let Z[G/iL] 
be the permutation G lattice with basis Ugu one can identify with the cosets of 
H in G. Let I = I[G/F[] C Z[G/H] be the G sublattice generated by elements 
of the form UgH — uh- In [LN] was shown that there is a natural one to one 
correspondence between a G H‘^{G,L*) which are split on FI and elements of 
Fixtcil, L*). Let La{I) be the field with associated twisted action. 

Note that from [S2] 0.4 the following universal property is easy. Suppose 
K D L is an L algebra with G action extending that on L. Assume a splits in 
K*. Then by [S2] 0.4, there is a G module map / : {La[I[G/ F[]])* — > K* which 
is the identity on L*. / induces an L algebra morphism (f>f : La[I[G / F[]] K. 
More explicitly, choose c a G — FI cocycle in a. Let Cgu G La[I[G/ H\\* split 
c and map to Ugu — ur G I[G/H]. Choose dgH G K* which splits c. Then 4>f 
is defined by the condition (j)f{egH) = dgH- 

The above universal property for La[I[G/ F[]\ extends to one for 
Consider Cgu G L/3[d"] via the embedding of / = I[G/H] in the first direct 
summand of Let Sn-i C Sn be the stabilizer of this first direct summand. 

Lemma 1.2. Suppose K j K is Sn Galois and there are dgH G (L © 
splitting c. Then there is a G(BS„ preserving L algebra morphism </> : L/3[L"] ^ 
L®p K with (j){egH) = dgH- 
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Proof. We define (j)f as above and then extend to L/ 3 [/"] in the unique way 
that preserves the S'„ action. □ 

Clearly an a G H‘^{G,L*) split by H defines a Brauer group element in 
Br(F) which is split by . Thus there is an algebra in this Brauer class 
with maximal subfield . In [S3] this algebra is described a bit more and 
we recall that here. Since a is split on H we observe in [S3] that a contains 
a cocycle c : G x G ^ L* such that c{G,H) = 1. Form the crossed product 
B = '^g^c Lug where UgX = g{x)ug and UgUg/ = c{g,g')ugg/ for all x G L, 
g, g' € G. As usual we can assume mi = 1. In B we can form the left B ideal, 
J, generated by all — 1 for all h G H . Then we define the G — H crossed 
product A = Z\(L^/F, G—i7, c) by setting A° = Ends (B/ J). We show in [S3] 
that A is central simple, is in the Brauer class of B, and has as maximal 
subfield. The reader could also easily verify these facts for themself. Note that 
B A° = Endi?(B/J) and we can view B/J as a left B A° module via 
this map. 

By construction B contains G = (BhenLuh which can be identified with 
the trivial crossed product A{L/L^ ,H). A maximal separable subring K C 
A° is called good if the map I k ^ {I k){l + J) is an isomorphism (j>K ■ 
L ®p K = B/J. Here L^p K is being viewed as a subring of B ^p A°. Via 
its canonical action on L, L ^p K is a G module. L ®p K is also a K space 
via the multiplication action of AT on AT, and so L^p K is a G^p K module. 

Lemma 1.3. (fp is a C ®p K module morphism. 

Proof. Let Vuh ®k'GG®pK and I ® k G L ®p K . Then 

(/kHI'uh ® k'){l (g) k)) = (fK{l'h{l) ® k'k) = ® K'K){1 + J). 

As elements of G ®p AT, Vh{l) ® k'k = {I' (g> k'){uh ® 1)(^ ® k){uh ® 1)”^- 
Furthermore, {uh (S> 1)(1 + J) = + J = 1 + J so {uh (g + J) = 1 + J. 

Thus (/'(gfc')('U/i(gl)(/(gA:)('U/i(g)l)“^(l + J) = {V 'Sik'){uh‘Sil){l'Sik){l + J) = 
{I'uh ® k')4>K{l ® k) as needed. □ 

Assume K is good. Then the isomorphism (fp induces 

ifp : End/f (A ®p K) = End/f (B/ J) = B (J)p K 

since K is self centralizing. Write LK = L ®p K and view this as a G Ga- 
lois extension of K. Note B ®p K is the (Azumaya) crossed product alge- 
bra A{L/F,G,c) ®p K = A{LK/K,G,c). We have ifp : A{LK/K,G,c) ^ 
Fndp (LK). For any g G G, (g 1 G Fndp (LK) = dLndp{L (g K) and we 
consider ipp^{g (g 1) = Vg. Since (j>p is an LK morphism, Vg{'q) = g{r])vg for 
all r] G LK. Thus Vg = d~^Ug for some dg G (LK)*. Since (j)p is a G mor- 
phism, Vh = Uh or dh = i. for all h G H. Since VgVg> = Vgg>, the dg’s split 
the cocycle c. We call dg the G-H splitting associated to a good K. Note that 
4>p^{ug + J) = Ug{l (g 1) = dgVg{l (g 1 ) = Jg. It follows that the L span of 
the dg is LK. If d'g G (LK)* are a G-H splitting of c where LK = Y/ Ld'g, we 
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call the d'g a good splitting. The above paragraph then gives a mapping from 
good K C A° to good G-H splittings in (LK)*. 

Conversely, suppose K/F is separable of degree [G : H] and B®pK\s split. 
Let LK = L®pK, and let dg G (LK)* be a good G-H splitting of c. Note this 
means dh = I all h G H and the dg L span LK. Set Vg = d~^Ug & B ®p K = 
A{LK/K, G, c) so using the Vg B ®p K = A{LK/K, G) = End/c(LiL). Since 
Uh{l 01) = h{l) 0 1 = 1 0 1 (remember Vh = Uh), there is a unique B module 
morphism (j) : Bj J LK. We have </>(% + J) = ® 1) = dg & LK. Since 

the dg are good, </> is an isomorphism inducing a f/' : EndF(.B/^) — Kndp{LK) 
and defines an embedding of K into A° = FindpiB/ J). The image of K 
is a maximal separable subfield and dg is obviously the associated good G-H 
splitting. 

We can now state: 

Theorem 1.4. Let A/F he a central simple algebra of degree n and X its 
Severi Brauer variety. Then S'^{X) is rational over F . 

Proof. We can write A = A{L^ / F,G — H,a). Then X has function field 
La{I[G / H])^ . We saw above that S'"(X) has function field 
where ft is the diagonal element induced by a. 

The idea of the proof is that this last field is isomorphic to the function 
field of the “variety of maximal separable subfields of T°” . This was partially 
done in [M], and will be included in a future paper by the first author. For 
our current purposes we will instead use a projective space birational to this 
variety, had we defined it. 

Let ao G A° be such that F{ao) is good. Let V C A° be an — n 
dimensional F-subspace such that F(ao) PV = (0). Set V = Fag + V . Let 
U' <Z V he the Zariski open subset such that a Is a K point of U' if and 
only if the following holds. First, K{a) C A° ^p K is maximal separable and 
good. Second, that K{a) n{V (^p K) = Ka. Since ag is an F point of U', U' 
is nonempty. It is immediate the conditions defining U' are homogeneous, so 
there is an associated open subset Lf C P(E) with inverse image U' C V. 

Let K be the function field of P{V), and a G Up C V ®p K an element 
associated to the generic point of U. Set K' = K{a) which is clearly a good 
maximal separable subring of A° ^p K. Write LK' = {L ®p K)K' and dg G 
{LK')* the associated splitting. Let K L> K' D K he Sn Galois over K such 
that K' = . Note that K always exists and we need not argue it is a field 

(though it is). Then LK = {L®pK)®kK is Galois over K with group G®Sn- 

Since the dg split c G a, there is a ^ ^ LK as in 1.2. Let S 

be total quotient ring of the image of L>, S' = and S = 

Note that S, S' are direct sums of fields and S' is a field. Glearly S' C K', 
so S' n (V S) = S' a', for some a' . Since a = ka' for some k G K, S{a') 
is n dimensional separable. More importantly, since a represents the generic 
point of P(E), S = K. Since K and both have transcendence 

degree n(n — 1) over F, is an injection and hence induces an isomorphism 
-b/ 3 (/")'^®‘^” = K. But K = F(P(V)) is rational over F. □ 
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This result may be applied to describe other symmetric powers S'^(X) for 
a given Severi-Brauer variety X. 

Theorem 1.5. Let A/F he a central simple algebra of degree n and X its 
Severi-Brauer variety. Let k < n. Then S'^{X) is birationally isomorphic to 
Vk{A) X where Vk{A) is the k-th generalized Severi-Brauer variety of 

kn- dimensional right ideals of A. 

Proof. Let Xk = Vk{A). If J e Xk{A) is a point of Xk defined over some 
field extension of we follow the notation of [K] and define V{J) = {/ G 
X\L C J}. If J is defined over a field L D F, then it is easy to see that 
V{J) is also defined over L a,s a closed subvariety of X. Define a rational map 
/ : n" X Xk via f{Ii,...,Ik) = ^li. It is easy to check that this is 
a rational morphism which is surjective at the algebraic closure and hence 
dominant. In addition, one can check that the closure of the fiber f~^{J) 
over a fcn-dimensional ideal J is simply /“^(d^) = n ^{J)- Since the map / 
is invariant under the action of the symmetric group Sk acting on Jj[ V{J), 
we get an induced map /' : S^{X) — + Xk. Chasing through the diagrams 
which define the relevant fiber squares, we find that f'~^{J) = {f~^{.J))/Sk = 

sHv{J)). 

Now, let J G Xk be the generic point, which we think of simply as a 
point of Xk defined over the function field F{Xk). We will show that the fiber 
f'~ (J) is rational, which implies our result. Set P = V{J), so P is a closed 
subvariety of X defined over F{Xk). By [K] Lemma 2, P = V{D) for some 
algebra D which is Brauer equivalent to xl 0 F{Xk), and with deg(P) = k. 
By the previous paragraph, it follows that f'~^{J) = S'^(P) = S^{V{D)). 
But since D has degree k, this is rational by the previous theorem. Therefore 
as the generic fiber is birationally isomorphic to it is also 

rational. □ 

For k > n, we state the situation up to stable isomorphism. For conve- 
nience of notation, if xl is a central simple P-algebra of degree n, we set Fk{A) 
to be the function field of Vk{A), where if fc > n, we define Vk{A) = Vk'{A) 
where k' < n, and n\k — k' . We further define Vq{A) = Spec{F). Set 
F{A) = Fi{A). 

Corollary 1.6. Let k be arbitrary. Then S^{F{A)) is stably isomorphic to 
Fk{A). Ln particular, S'"*(P(g1)) is stably rational. 

Proof. Suppose k = nl + r where r < n. We want to show that S^{F{A)) 
is stably isomorphic to Fr.{A). Set B = Mi+i{A). Then F{B) is rational 
over F{A), so by lemma (the one at the end of the first section), S^{B) is 
rational over S'^(Gl). By the previous theorem, S^{B) is rational over Fk{B), 
and Fk{B) = P„(;+i)_fc(P°) = Fn-r{B°) which is rational over Fn~r{A°) = 
Fr{A). □ 
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2 Unramified Cohomology 

Of course, one would like an example like 1.4 but over an algebraically closed 
field. That is, one would like a nonretract rational K/F such that S'^{K)/F 
is retract rational for F algebraically closed. In this section we will prove a 
result that will indicate that this might be hard. That is, we will show that 
one cannot use unramified cohomology to construct a nonretract rational if/T’ 
such that S'^{K/F) is retract rational. 

We begin by recalling a bit about unramified cohomology. For convenience 
assume the ground field F contains all roots of one. If A is any torsion abelian 
group, we will write A! to mean the elements of A whose order is prime to the 
characteristic of F . Of course, if F has characteristic 0, A! = A. Let ^ C F* 
be the group of roots of one, and Kg the separable closure of the field K. 
Denote by F[^{K,M) the Galois cohomology group H^{Gk,M) where Gk is 
the Galois group oi Kg/ K and M is a continuous Gk module (for example /x 
or K*g). Note that by standard arguments F[^{K,fj,) = H^{K,K*Y for i>2. 

Suppose K/F is any field, and R CL K is discrete valuation domain con- 
taining F with field of fractions K. Then for any i > 2, R induces a residue 
map ramij : H'^~^{R, n) where R is the residue field of R. Note 

that the assumptions mean all discrete valuation rings have unmixed charac- 
teristic. 

We recall the definition of the residue map, slightly generalizing [SI] p. 
213 to cover the nonzero characteristic case. Since /x C F*, we can identify 
fj, with (Q/Z)'. Let Q' be the inverse image of (Q/Z)' and let Z' be the 
prime to the characteristic part of the profinite completion Z, or equivalently 
Hom(/x, Q/Z). Define II to be the abelian group /i 0 Q' with the Z' action 
cr(s 0 Z, r) = (s 0 r 0 Z, r) where cr is the canonical generator of Z'. If G is 
any profinite group, we view II as a G0Z' module using the trivial G action. 
Note that since Q' is uniquely n divisible for n prime to the characteristic, 
H\G 0 Z', ^i) 0 H\G 0 Z', 77)'. 

Arguing just as in [SI] (using the Hochschild-Serre spectral sequence) 
the inflation map 77*(G, /x 0 Z)' ^ 77*(G 0 Z',77)' is an isomorphism for 
i >2. More easily, the coboundary maps defines an isomorphism H^~^{G, /x) 0 
H'^{G,iy . Define ram: FT^ {G (B , n) 77*“^(G,/x) to be the composition 

77'(G 0 Z', fi) ^ 77'(G 0 Z', 77)' 0 77'(G, /x 0 Z)' ^ 77'(G, Z)' 0 H^~\G, /x) 

where the arrows are the obvious maps and the isomorphisms are described 
above. 

We are ready to define the residue map as follows. Given K, R, form the 
completion K with respect to R. li K' LC K is the maximal tamely ramified 
extension, then associated to K' there is an exact sequence 

1 ^ G^ ^ G^0Z' ^ 1 

where P is a profinite p group if 0 yf p is the characteristic of K and P = 1 
otherwise. In the nonzero characteristic case, H^{P, /x) = 0 for all x > 0 and so 
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(by Hochschild-Serre again) inflation induces an isomorphism iJ®(G0Z', /x) = 
/x). The residue map ram/j is the composition H^{K, fi) — > H^{K, fj,) = 
0 Z',/x) ^ where the last arrow is the ram map above. 

We need the following basic properties of this residue map which are well 
known but a bit hard to And. 

Proposition 2.1. Let K\ C L\, he fields and R a discrete valuation ring with 
q{R) = Ki. 

a) Suppose S C L\ is a discrete valuation domain, q{S) = L\, and S 
over R. Let Res : H^{Ki,ii) il*(Ti,/x) be the restriction map and set 
e = e{S/R). Then for i >2 the following diagram commutes: 






Res 



e Res 






b) Suppose Li/Ki is finite separable, and Si, . . . ,Sr are the discrete val- 
uation domains with q{Sj) = L\ and such that the Sj lie over R. Let 

Cot : HfiLi, fi) ^ H\Ki, fx) 



be the corestriction map. The following diagram also commutes. 



H\Ki,p) 



i;Cor 



H--\R,pi) 



where all horizontal arrows are residue maps and U Cor means the sum of the 
corestriction maps for Sj/ R. 

Proof, a) Let Li, Ki be the completions of Li at S and Ki at R respectively. 
Then we can view K\ C Li. This induces a map G^^ ^ ki then a map 

t : Gg 0 Z' ^ Gg 0 Z'. If ttr, TTg are primes of R,S, then 7t_r = wig ior u & S 
a unit. It follows that the diagram 



Gg 0 Z' ^ Z' 

L e 

j N' 

Gp. 0 Z' ^ Z' 



commutes. Let LIr, LIs be the Gp 0 Z' respectively Gp 0 Z' module induced 
from LL by the respective projections. Let II' be the Gg 0Z' module induced 
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from Uft, by t. It is easy to see that II' = IIs and in fact that there is a 
commutative diagram: 



I ^ IIs 

s 

I- ^ W 



Part a) is now immediate. 

As for b), let K be the completion of K with respect to R and let Lj be 
the corresponding object for L and Sj. Then L®kK = ®jlj and the diagram 



Cor 



/i) 

SCor 

'■ 



commutes. This it suffices to prove b) in the case K = K, and there is only 
one extension S. By composition it suffices to consider the two cases L/K \s 
unramified and L/K \s totally ramified. 

If L/K is unramified, we can choose the prime tt to be prime in both R 
and S, so the inclusion Gg 0 Z' C Gf^ 0 Z' respects the direct sums and is 
the identity in Z'. This case of b) follows from the naturality of corestriction. 
On the other hand, if L/ AT is totally ramified then G^ = Gg Emd any element 
^ Af*(Gs0Z',^) ^ iJ;(Gs 0 Z',77)' ^ iJ*(Gg, /x 0 Z)' = 
H''{Gji, /X 0 Z)' is in the image of /x). Thus b) follows from a). □ 

We define the unramified cohomology C iJ*(AT, /x) to be the 

intersection of the kernels of ram/j for all R as above. The point about this 
cohomology is that it detects nonrationality. Let lm{LL{F, C H^{K,n) be 
the image under restriction. If K/F is retract rational, then iJ*(AT, /x)u = 
Im(iL*(F, /x)) for all i>2. From the 2.1 above we immediately have: 

Corollary 2.2. Suppose K\ C L\ are fields containing F. Then the restric- 
tion mapH'{K,p) ^iL*(L,/x) takes iL*(AT,/x)„ to H'{L, fi)u- If L/K is finite 
separable, then the corestriction iJ®(L,/x) ^ H'{K,pl) also preserves unrami- 
fied elements. 

We want to show that specialization preserves unramified elements. To 
this end, suppose Ki D F is a field. Assume i? is a discrete valuation domain 
with q{R) = K\ and a G H'{K,fj,) is in the kernel of ram/j. Then a maps to 
a G LF{K, p) = iL*(G^0Z', p) = H^{Gji, M®Z)'. Since rami^(a) = 0, d maps 
to 0 in iL*(G^, Z) and hence comes from an element of H'{Gp, h) = H'{R, /x). 
We call this element api and think of it as the specialization of a at R. We 
claim: 




Daniel Krashen and David J. Saltman 



Proposition 2.3. Let R be a discrete valuation domain containing F and 
Ki = q{R). Suppose a € H^(Ki, /j.)u- Then an G H'‘{R,fj,)u- 

Proof. Let Ki be the completion of Ki at R. By 2.2, the image, a is in 
p,)u- By e.g. [Se] p. 33, Ki = R{{t)). Since ram/j(a) = 0, the above 
argument shows that a is the image of an G FT‘{Gji, p). Thus a is the image 
of Ur G H^{R, p), where R is viewed as a subfield of Ki. 

Suppose S' C .R is a discrete valuation domain containing F with q{S) = R. 
Then S extends to a discrete valuation domain Si with residue field S((t)) 
such that e(Si/S) = 1 and q{Si) = Ki. Let [3 = ram 5 (o;;j). By 2.1 a), the 
image of (3 in iL*“^(S((l)), /r) equals ramsj(o;) = 0. Thus we are done once 
we show: 

Lemma 2.4. The map H\k,p) Fl^ {k{{t)) , p) is injective. 

Proof. Since P[^ (k{{t)) , p) = H^{Gk © Z', p), it suffices to show the injectivity 
of P[^{Gk,p) H'^{Gk © Z', /r), which is obvious. □ 

Suppose next that R,M is a, regular local domain with q{R) = Ki and 
residue field R. Let , . . . , be a fixed R sequence generating M . The the 
localization R(xi) is a discrete valuation domain with residue field k\ and the 
image of i? in ki, call it Ri,Mi, is a regular local ring with q{Ri) = k\. 
In addition, the images of the Xi, i > 1, form an R sequence generating Mi. 
Thus by 2.3 and iteration, an a G H^{Ki,p)u induces aau G H'‘{R, p)u. More 
generally, we make the following recursive definition. Suppose a G P[^{Ki, p). 
We say ur G /x) is defined if a is unramified at R(xi) and the image of 

a in P[^{ki,p), call it ai, satisfies that is defined where R = R/{xi) 

with R sequence the images of X 2 , ... ,Xn. Of course we showed above that if 
a G P[^{Ki, p)u, then aR is defined. 

From the definition, it looks like aR depends on the choice of ordered 
R sequence. We do not know whether this is actually true. Luckily we can 
avoid this issue, at least in this paper. We do need other properties of this 
construction, as follows. 

Lemma 2.5. Let R be a regular domain with given R sequence containing the 
field Li. Let q{R) = Ki. 

a) Suppose a,f3 ^ H^{Ki,p) and urMr both defined. Then {a + /3)r 
is defined and equals aR + (3r. 

b) Suppose a G H^(Ki,p) is the image of a' G H^{Li,p). Then aR G 
/x) is defined and is also the image of of . 

c) Suppose S is a regular domain lying over R and define specialization at 
S using the the same R sequence. Let L\ = q{S). Then the following diagram 
commutes, where the horizontal maps are specialization and the vertical maps 
restriction: 
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Proof. By induction we may assume R and S are discrete valuation domains. 
Part a) is now obvious and part b) follows from the fact that the composition 
C Gki Gli is just the canonical map ^ Gli - Part c) follows from 

the commutativity of: 

Gl, G5 

Gk, G« 

which is obvious. □ 



Unramified cohomology will not help with this paper’s problem because 
of the next result. We say has a smooth rational point if there is a 

smooth local domain with residue field F and q{R) = Note this is 

always true if F is algebraically closed or K is unirational. 

Theorem 2.6. Suppose has a smooth rational point. If 

W{S^{K/F),fa)^ = lm{W{F,fi)), 

then H^{K, /i)„ = lm(H^{F, p)). 

Proof. Since we actually prove the contrapositive, suppose a G /i)„ and 

a ^ Im(iJ*(F, p)). The field extension q{K'^)/S^{K) is clearly S'„ Galois, and 
we can set L = Notice that L = q{K S^~^{K)). In particular, 

K C L. Let ap G H^{L,p) be the image of a and (3 = Corgnf^p^{aL). By 2.1, 
(3 G H^{S^{K/F),p)u. It will suffice to show that that 

(3ilm{W{F,p)). (1) 



If (3l G H^{L,p)u is the image under restriction of (3, it suffices to show 



Pl i lm{H\L,p)). 



(2) 



Recall that L = KS'^ Now by the restriction-corestriction formula (e.g. 

[B] p. 82), Pl = cxl + 1 where 7 is a sum of elements which have the form 



Cor 



S „_1 

Sn-ina(Sn-l) 



(Res 



S„_incr(S„_i) 



{<j{aL))) 



where a ^ S',!-!. It follows that 7 is in the image of 7 ' G p)u. 

Also note that since Pl and ap lie in H^{L,p)u, then 7 G H'^{L,p)u also. 

Let i?, Ad be a smooth local domain with q{R) = and RfM = F. 

Let S C L = KS'^~^{K) be the natural extension with the same R series, 
q{S) = L, and residue field K. By 2.5 c), 75 is in the image of H^{F,p). If 
(2) fails, then (q;l)s is in the image of H'‘{F,p). But by 2.5 b), (ai)s = a, 
contradicting the assumption. □ 
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Abstract. This article consists of three parts that are largely independent of one 
another. The first part deals with the projective geometry of homogeneous varieties, 
in particular their secant and tangential varieties. It culminates with an elementary 
construction of the compact Hermitian symmetric spaces and the closed orbits in 
the projectivization of the adjoint representation of a simple Lie algebra. The second 
part discusses division algebras, triality, Jordan agebras and the Freudenthal magic 
square. The third part describes work of Deligne and Vogel inspired by knot theory 
and several perspectives for understanding this work. 



1 Overview 

This article has two purposes. The first is to provide an elementary introduc- 
tion to papers [59, 60, 61, 62, 63], related works and their historical context. 
Sections 2. 1-2. 3, 2. 5-2. 6, 3. 1-3.5, 4. 1-4.3 should be accessible to a general au- 
dience of mathematicians. The second is to provide generalizations, new per- 
spectives, and complements to results in these papers, i.e., things we thought 
of after the papers were published. In particular, we mention 2.5, 2.7, 3.4 and 
3. 6-3. 9. Each section begins with a description of its contents. 

Simply put, our goals are to use geometry to solve questions in represen- 
tation theory and to use representation theory to solve questions in geometry. 

On the geometric side, the objects of interest are homogeneous varieties 
X = G ! P G FV. Here G is a complex semi-simple Lie group, V is an irre- 
ducible G-module, X is the unique closed orbit (projectivization of the orbit 
of a highest weight vector) and P is the stabilizer of a point. For example, 
let W = C™ and let X = G{k, W) C F{A^W), the Grassmannian of fc-planes 
through the origin in W. Here G/P = SL(1T)/P, V = A'^W. We are more 
generally interested in the geometry of orbit closures in ¥V. 

Basic questions one can ask about a variety are its dimension, its degree, 
and more generally its Hilbert function. We may ask the same questions for 
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varieties associated to X. For example the degrees of the dual varieties of 
Grassmannians are still unknown in general (see [67, 26, 78]). 

Other types of problems include recognition questions. For example, given 
a variety with certain geometric properties, are those properties enough to 
characterize the variety? For an example of this, see Zak’s theorem on Severi 
varieties below in Section 2.6. For another example, Hwang and Mok charac- 
terize rational homogeneous varieties by the variety of tangent directions to 
minimal degree rational curves passing through a general point, see [44] for 
an overview. Some results along those lines are described in Section 2.5 below. 
We also mention the LeBrun-Salamon conjecture [68, 69] which states that 
any Fano variety equipped with a holomorphic contact structure must be the 
closed orbit in the adjoint representation Jfad C Pg for a complex simple Lie 
algebra. In this context also see [8, 52]. 

On the representation theory side, the basic objects are g, a complex 
semi-simple Lie algebra and V, an irreducible g-module (e.g., g = s[(IF), 
V = yl^IF). Problems include the classification of orbit closures in ¥V, to 
construct explicit models for the group action, to geometrically interpret the 
decomposition of P®* into irreducible g-modules. We discuss these classical 
questions below, primarily for algebras occuring in “series” . 

Vassiliev theory points to the need for defining objects more general than 
Lie algebras. We have nothing to add about this subject at the moment, but 
the results of [62, 63] were partly inspired by work of Deligne [24] and Vogel 
[82, 83] in this direction. 

For the mystically inclined, there are many strange formulas related to the 
exceptional groups. We present some such formulas in Sections 4.3, 4.6 below. 
Proctor and Gelfand-Zelevinski filled in “holes” in the classical formulas for 
the ospn series using the non-reductive odd symplectic groups. Our formulas 
led us to exceptional analogues of the odd symplectic groups. These analogues 
are currently under investigation (see [65]). 

When not otherwise specified, we use the ordering of roots as in [9]. 

We now turn to details. We begin with some observations that lead to 
interesting rational maps of projective spaces. 



2 Construction Of Complex Simple Lie Algebras 
Via Geometry 

We begin in Section 2.1 with three ingredients that go into our study: local 
differential geometry (asymptotic directions), elementary algebraic geometry 
(rational maps of projective space) and homogeneous varieties (the correspon- 
dence between rational homogeneous varieties and marked Dynkin diagrams). 
We then, in Sections 2. 2-2. 4 describe two algorithms that construct new vari- 
eties from old that lead to new proofs of the classification of compact Hermi- 
tian symmetric spaces and the Gartan-Killing classification of complex simple 
Lie algebras. The proofs are constructive, via explicit rational maps and in 
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Section 2.5 we describe applications and generalizations of these maps. Our 
maps generalize maps used by Zak in his classification of Severi varieties and 
in Section 2.6 we describe his influence on our work. In Section 2.7 we return 
to a topic raised in Section 2.1, where we determined the parameter space of 
lines through a point of a homogeneous variety X = G/P. We explain Tits’ 
correspondences which allow one to determine the parameter space of all lines 
on X and in fact parameter spaces for all G-homogeneous varieties on X. 
We explain how to use Tits correspondences to explicitly construct certain 
homogeneous vector bundles, an in turn to use the explicit construction to 
systematize Kempf’s method for desingularizing orbit closures. 



2.1 Differential Geometry, Algebraic Geometry 
and Representation Theory 

2.1.1 Local Differential Geometry 

Let A” C P”+“ be an algebraic variety. 

Question 2.1. How to study the geometry of A? 

One answer: Take out a microscope. Fix a smooth point x € X and take 
derivatives at x. The first derivatives don’t yield much. One gets T^X, the 
embedded tangent projective space, the union of lines (linearly embedded 
P^’s) having contact to order one with A at x. (Contact to order zero means 
the line passes through x.) 

Sometimes we work with vector spaces so for Y C W we let A C V 
denote the cone over Y and we let T^X = T^X. Let T^X denote the Zariski 
(intrinsic) tangent space to A at x. We have T^X = x* ®TxX/x, see [59]. 

Taking second derivatives one obtains a variety Y = Yx,x C PTj,A whose 
points are the asymptotic directions, the tangent directions to lines having 
contact to order two with A at x. 
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In an attempt to get global information from the asymptotic directions, 
restrict to the case where x € X is a general point 

Question 2.2. How much of the geometry of X can be recovered from Yx,x C 
PT,,X? 

Answer: Usually not much. For example, if X is a smooth hypersurface, 
then Y is always a smooth quadric hypersurface, i.e., all smooth hypersurfaces 
look the same to second order. 

The set of asymptotic directions is the zero set of a system of quadratic 
equations generically of dimension equal to the codimension of X (unless the 
codimension of X is large, in which case it is generically the complete system of 
quadrics). If X is sufficiently pathological one might hope to recover important 
information about X. 

Consider the Segre variety, Seg(P^ x P*) C P(C^+^ 0 of rank one 
matrices in the space of all (fc + 1) x (/ + 1) matrices. A short calculation 
shows Xseg,a; = P*“^ U P*“^, the disjoint union of a P'^”! with a P*“^. (Note 
that the codimension is sufficiently large here that one would expect Y to be 
empty based on dimension considerations.) 

Griffiths and Harris [37] conjectured that if Z C P® is a variety of dimen- 
sion 4 and z & Z a, general point, if Yz,z C PT^Z is the disjoint union of two 
lines, then Z = Seg(P^ x P^) C P®. 

Theorem 2.3. [58] Let k,l > 1, let Z^^^ C P^ he a variety, and let z G Z he 
a general point. IfYz,z = LI P*“^, then Z = Seg(P'^ x P'). 

Moreover, the analogous rigidity is true for varieties having the same 
asymptotic directions as X = G{2,m) C P(A^C’"), the Grassmannian of 
two-planes in C™ in its Plucker embedding, with m > 6, and the complex 
Cayley plane Eq/Pq = OP^ C P^® [58]. We recently prove similar rigidity 
results for homogeneous Legendrian varieties [64]. 

The rigidity results hold in the C°° category if one replaces the word 
“general” by the word “every” . 

If one adds the global assumption that Z is smooth, the results also hold 
for X = G(2, 5) and X = S5 C P^®, the spinor variety using different methods. 

We are unaware of any second order rigidity results for nonhomogeneous 
varieties. Thus, purely from the most naive differential geometry, one already 
encounters homogeneous varieties as examples of the most rigid projective 
varieties. In fact, so far we have just encountered the most homogeneous ones, 
the ones admitting Hermitian symmetric metrics. For more on this and the 
rigidity of other homogenous varieties see Section 2.5. 

We define a homogeneous variety X = GjP C PV to be minuscule if 
G is simple, X admits a Hermitian symmetric metric and X is in its mini- 
mal homogeneous embedding. X is said to be generalized minuscule if it is 
homogeneously embedded and admits a Hermitian symmetric metric. 
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Remark 2. 4- If X C TV is a variety cut out by quadratic polynomials, then 
the asymptotic directions Y C TT^X are actually the tangent directions to 
lines (linearly embedded P^’s) on X . Rational homogeneous varieties are cut 
out by quadratic equations, in fact if X C PRa, then the ideal is generated by 
V^2A^ C 

2.1.2 Lie Groups and Homogeneous Varieties 

Let G be a complex (semi)-simple Lie group and let V be an irreducible 
G-module. Then there exists a unique closed orbit X = G/P C TV. 

Examples. 1. G = SL(n,C), the group preserving det G yl"C”*, V = d^C”, 
X = G{k,n), the Grassmannian of fc-planes through the origin in C". 

2. G = SO(n, Q), the group preserving a nondegenerate Q G V = 

yl^C", X = GQ{k,n), the Grassmannian of Q-isotropic fc-planes through the 
origin in C". 

3. G = Sp(n,w), the group preserving a nondegenerate w G d^C”*, V = 
j Aw), X = Guj{k, n), the Grassmannian of w-isotropic fc-planes 

through the origin in C". Here n is usually required to be even (but see [73, 36], 
and Section 4.3). 

Since linear algebra is easier than global geometry, we work with g = TijG, 
the associated Lie algebra. 

About a century ago. Killing and Gartan classified complex simple Lie 
algebras. Thanks to Goxeter and Dynkin, the classification can be expressed 
pictorially. (See [40] for a wonderful account of their work and the history 
surrounding it.) 
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If a diagram has symmetry, we are allowed to fold it along the symmetry 
and place an arrow pointing away from the hinge to get a new one: 
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For example, C„ is the fold of A 2 n-i- Given a semi-simple Lie algebra g, we 
let D(g) denote its Dynkin diagram. 

Returning to geometry, homogeneous varieties correspond to marked dia- 
grams 



o o • o o o 

G(3,7) 



o o • o- 

Gq(3, 14) 



.o 



'o 



Note in particular that P" has marked diagram 



o 



P" 

If S' is a subset of the simple roots of G, we use Ps to designate the 
parabolic subgroup of G corresponding to the simple roots in the complement 
of S. The Dynkin diagram for G/Ps is the diagram for G with roots in S 
marked. Also, if S consists of a single root {a} and a = at, we write Ps = 
P — P 

Unless otherwise specified, we take PU to be ambient space for the the 
minimal homogeneous embedding of G / P. For example, li P = Pa is maximal, 
then U = Uj where lo is the weight Killing-dual to the coroot of a. 

Back to our question of how to study homogeneous varieties: 

Idea: Study X CfV viaY = Yx,x C PT,A. 

For this idea to be a good one, Y should be a simpler space than X and it 
should be possible to determine Y systematically. Although Y is indeed cut 
out by quadratic equations, and has dimension strictly less than that of X, 
X is homogeneous, and Y need not be. 

The following theorem originates with work of Tits [81], amplified by Co- 
hen and Cooperstein [18]: 

Theorem 2.5. [59] Let X = GjPa C PU he a rational homogeneous variety 
such that a is not short {i.e., no arrow in D{g) points towards a). 

Then Y C PT^X is homogeneous, in fact generalized minuscule {as defined 
above). 

Moreover, Y can he determined pictorially: remove the node corresponding 
to a from D{g) and mark the nodes that were adjacent to a. One obtains 
a semi-simple Lie algebra f) with marked diagram. The resulting homogeneous 
space H/Q is Y. 

Example 2.6. 




A = Gq(4,12) y = Seg(p3 X G(2,4)) 
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The _ff-modules {Y) are studied in [49] where they are called type-I 6- 
representations . 

The embedding of Y is minimal iff the diagram is simply laced. In the case 
of a double edge, one takes the quadratic Veronese embedding, for a triple 
edge, one takes the cubic Veronese (see the algorithms below). 

Remark 2.1. In [59] we explicitly determine Y in the case of short roots and 
in fact arbitrary parabolics. We also give geometric models. In the case of 
X = GjPa with a short, Y is the union of exactly two G-orbits, and the 
closed orbit has codimension one in Y . 

If Y is still complicated, one can continue, studying the asymptotic direc- 
tions of V at a point. Eventually one gets (Segre products of re-embeddings 
of) CP^, the one homogeneous space we all pretend to understand. 

We describe our discovery that one can reverse this infinitesimalization 
procedure below. First we need to review some elementary algebraic geometry. 

2.1.3 Embeddings Of Projective Space 

Recall the Veronese embeddings of projective space: 

Vd : PV ^ P(S"^V), 

[w] 1-^ [w'*]. 

Dually, let P^,..., Pn be a basis of S^V*. The map is 

[w] 1-^ [Po(i«), . . . ,Pjv(w)]- 

A remarkable fact is that all maps between projective spaces ¥V FW 
are obtained by projecting a Veronese re-embedding. 

If we project to P(S"^V/L) where C S'^V* has basis Qo,. . . , Qm, the 
map is 

/ : PV ^ P(S"^V/L), 

[ic] 1-^ [<5o('u:), . . . ,Qm{w)] 
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The image of / is smooth and isomorphic to W iff no secant line of Vd{VV) 
intersects L. 

In the following algorithm we will actually be interested in images that get 
squashed in the projection so that they are no longer isomorphic to P" (but 
are still smooth). 

2.2 First Algorithm 

We are about to describe an algorithm, which you might like to think of as 
a game. Starting with P^ as initial input we build some new algebraic varieties 
subject to certain rules. The game has rounds, and in each new round, we are 
allowed to use the outputs from previous rounds as new inputs. 

We fix some notation. 



Initial input 

pi ^ pi 



RESERVOIR - 



Let Y = Seg(%i (W) x • • • x Wd,(W)) C = PT 
with Xj C P^-^ in the RESERVOIR 





Let d be the smallest integer such that 
cTd(y) = PT = P"-i 

Linearly embed PT C P*^ as the hyperplane {I = 0}. 
Consider the rational map 



(p : P" > P^ C P(S“*C"+^) 

Let A = y(P") C P^. Call A an OUTPUT. 



Fig. 1. First Algorithm 
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Let X c TV , Y c TW , be varieties. 

Seg(X X F) C P(F ^W) is the Segre product, ([x], [j/]) [x^y]. Some- 

times we just write X x Y with the Segre product being understood. 

<Jk{X) C TV is the union of all secant to X. We let a{X) = a 2 {X). 

T{X) C G(2, V) C P(tI^PF) denotes the union of all tangent lines to V. 
(Recall G(fc, V) is also the space of P'^^^’s in PF.) 

X <ZV is the cone over X and {X) C V denotes the linear span of X. 

Given Y C TW, we let Ik{Y) C S^W* denote the component of the 
ideal in degree k. In the flowchart below we slightly abuse notation by letting 
Ik{Y) denote a set of generators of Ik{Y). Similarly, we let T* be shorthand 
for a basis of T*. 

For the first run through the algorithm, the admissible varieties and their 
outputs are as follows 



Y C P"-i, X” C P^, 
pi C pi, p2 C p2, 
pi X pi c P^, Q"* C P®, 

W2(P^) c p2, p4_ 



Here and below, Q™ C P™+i denotes the smooth quadric hypersurface. 
For the second round. 



Y 

p2 

U2(P2) 

pi X P^ 

p2 ^ p2 

Q4 

Q3 



c 


P"-1, 


X” 


C 


pW, 


c 


p2, 


p3 


C 


P3, 


c 


p3. 


G^(3,6) 


C 


Pll, 


c 


p3. 


G(2,5) 


C 


P^ 


c 


p8. 


G(3,6) 


C 


pl9. 


c 


P3, 


Q6 


C 


p8. 


c 


P4, 


Q5 


C 


pi". 



Here G{k,l) denotes the Grassmannian of /c-planes in C* and Gi^{k,2k) de- 
notes the Grassmannian of Lagrangian /c-planes for a given symplectic form. 

Question 2.8. What comes out? Since the algorithm goes on forever, is it 
even possible to answer this question? 

Proposition 2.9. [60] The algorithm is effective. A priori, r,dj < 2 and the 
algorithm stabilizes after six rounds. 

So at least our question is reasonable. Now for the answer: 

Theorem 2.10. [60] OUTPUTS = MINUSCULE VARIETIES. 

Corollary 2.11. [60] A new proof of the classification of the compact Hermi- 
tian symmetric spaces without any reference to Lie groups. 
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We have the following stable round: 




Y C P"-i, 


A” C P^, 


pn-l g p«-l^ 


P” C P", 


^^(pm-l) ^ p("*2+')-l^ 


Guj{m,2m) C pC™+i-i 


■i 

u 

7 

X 

1 


G{k,k + l) C 


Q2m— 2 ^ p2m— 1 


Q2m ^ p2m+l 


Q2m— 1 ^ p2m 


Q2m+1 ^ p2m+2 


G(2,m) C p( 2 )-i, 


S™cp2-^-i. 



Here Cm+i = Catalan number. The spinor 

variety Sm of Dm consists of one family of maximal isotropic subspaces of 
(j^ 2 m endowed with a nondegenerate quadratic form and embedded in the 
projectivization of one of the two half-spin representations. 

The most interesting (but terminal) path is: 

Seg(pi X P2) = Ai/Pi X A 2 /P 2 

I 

G(2,5) = A4/P2 

i 

§5 = D^/P^ 

i 

OP2 = Eq/Pq 

i 

GUO^O^) = E^/P-r. 



Here OP^ = i? 6 (_i 4 ) is the complexification of OP^ = F 4 /Spiug, the cele- 
brated Cayley plane discovered by Chevalley. As a topological space, OP^ is 
built out of three cells of dimension 0,8 and 16. It is p 4 (_ 2 o) in the notation 
of Tits (see, e.g., [70]). The notation Gu,(0^,0®) is discussed in Section 4.6. 

2.3 Second Algorithm 

Now that was fun, but it was a shame to throw away some of our favorite 
varieties like V 3 (P^) and Seg(P^ x P^ x P^). Let’s revise the algorithm slightly 
and have just one consolation round. Given a smooth variety Y C PC, we let 
r(y) C PC denote the union of all points on all embedded tangent lines to Y. 
This algorithm is also effective. We show a priori that r, dj <3. 

So, what do we get??? 

Theorem 2.12. [60] OUTPUTS = Fundamental adjoint varieties X C Pg. 

The fundamental adjoint varieties are the closed orbits in the adjoint rep- 
resentation when it is fundamental. The Lie algebras whose adjoint varieties 
are not fundamental are the pathological A„ and its fold (when foldable) Cm- 
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MINUSCULE VARIETIES 

1 

Let y = Seg(%i(Xi) x • • • x C = PTi 

with Xj C minuscule 

1 

Is codim (T(y)) = 1 ? 



YES 



Linearly embed PTi C{i=o} P*^ ^ C{m=o} P"- 
Consider the rational map 

^ : pn ^ P(S'4C" + ^) 

II 

F{l\l^m,l^T^,l^l2{Y),l^mT^ -lh{r{YUng),l^m^ - h{r{Y))}. 
Let X = V3(P") C P^. Call X an OUTPUT. 



OUTPUTS 

Fig. 2. Consolation prize (one round) 





Our algorithm again provides a beautiful and easy proof of the classification 
of fundamental adjoint varieties. We also account for these two pathological 
cases, but it involves some less elegant work. We do obtain: 

Corollary 2.13. [60] A new proof of the Cartan-Killing classification of com- 
plex simple Lie algebras. 

The examples for the adjoint algorithm are as follows: 

y c P"- 2 , 0 , 

W3(P^) C P^, 02 , 

pi ^ Qm-4 ^ p2m-5^ 

G„(3,6)CP13, f4, 

G(3,6)cPi9, eg, 

Se C P3i, C7, 

G^(03,06) c P5^ eg. 
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The two exceptional (i.e., non- fundamental) cases are 

pfc-3|jpfc-3 p2fc-3^ 

0 C Sp2m- 

Note that the algorithm works in these two cases, we just didn’t have the 
varieties in our reservoir. (In the case of 5p2m> it may have been there and 
just difficult to see.) 

2.4 Outline Of the Proofs 

The proofs have three ingredients: differential invariants, local Lie algebras, 
and relating Casimirs to geometry. 

2.4.1 Differential Invariants 

Given a variety X C Pl^ and x G X, we can recover X from its Taylor 
series at x. The projective differential invariants comprise a series of tensors 
encoding the geometric (i.e., invariant under GL(V)) information in the Taylor 
series. We prove a priori facts about the differential invariants of any putative 
minuscule variety or fundamental adjoint variety. 

2.4.2 Local Lie Algebras 

A local Lie algebra is a graded vector space 

0-10 00 0 01 

equipped with a bracket for which go is a Lie algebra. The bracket must respect 
the grading but the Jacobi identity need not hold. If the Jacobi identity fails, 
one can construct a (unique) Z-graded Lie algebra from the local Lie algebra. 
The traditional way to do this (see, e.g., [48]) is to take the free algebra 
generated by the brackets and then mod out by the relations. Note that if one 
does that, one has no idea how many factors (if any at all) one will be adding 
on to obtain the final result. 

The data Y = H/Q C PTi furnishes (up to scale) a local Lie algebra with 
00 = () 0C, 01 = Ti, g_i = Tj. Here the action of C is as a scalar times the 
identity and we do not initially specify the scalar. 

Since this does give rise to a unique Z-graded Lie algebra, (in particular, 
a Lie algebra equipped with a representation V supported on one fundamental 
weight), we can study the resulting homogeneous variety X' = G/P C PV , 
and calculate its differential invariants. 

Note that if X' is minuscule, g = g^i 0 go 0 gi and if X' is adjoint, g = 
0-2 0 0-1 0 00 0 01 0 02 with g ±2 = C. 
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2.4.3 Compare X' With the Constructed Variety X 

We compare the differential invariants of X and X' and show that they are 
the same. The key point in the minuscule case is that a local Lie algebra is 
already a Lie algebra iff the Jacobi identity holds. We show this is the case iff 
yl^gi is an eigenspace for the Casimir operator of tj. We then connect this to 
the geometry by showing that (T(Y)) is a Casimir eigenspace! 

For the adjoint case the idea is similar: one shows that one can get away 
with a one-dimensional correction. 

2.5 Applications, Generalizations and Related Work 

2.5.1 More General Algorithms 

The adjoint algorithm (with a different test for admission) also constructs 
all homogeneous varieties and representations corresponding to a five step 
grading. M. Dillon is currently formulating more general constructions for 
gradings including extensions to affine Lie algebras. (The algorithms have no 
hope of being effective for graded Lie algebras with exponential growth.) An 
amusing exercise is to construct the grading of associated to a^. Here 
i) = a 4 + tt 4 , and 

Y = Yi = G(2,5) X = Seg(G(2, V) xFW) CF{A^V®W) =Pgi, 

Fa = Seg(PV* x G(2, W)) C V{V* O A'^W) = Pga, 

Fa = Seg(PF x G(2, IF*)) C P(F O H^IF*) = Pga, 

F 4 = Seg(G(2, V) X PIF*) C V{A^V(g)W*) = Pg 4 , 

and then the cycle repeats. Note that all the varieties are isomorphic as vari- 
eties and they appear in all possible combinations in terms of the fj-action. 

In this context, a result of Kostant [56] (Theorem 1.50) is interesting. He 
determines, given a reductive Lie algebra r and an r-module V, when r + F 
can be given the structure of a Lie algebra compatible with the r-actions (and 
in how many different ways). 

2.5.2 Constructions In an Algebraic Context 

Let A be an algebra with unit and involution a 1 -^ a. B. Allison [2] defines A 
to be structurable if the following graded vector space is actually a graded Lie 
algebra. Let 

g(A) = g -2 © g^i © go © 01 © 02 

with g±i ~ A, 0±2 — 5(A) := {a & A\a = —a} and go the set of derivations 
of A generated by linear maps Va,b '■ A^ A, where Va,b{c) = {ab)c + {cb)a — 
{ca)b. 

g(A) always has a natural bracket, and is a Lie algebra iff the Jacobi 
identity holds. In analogy with our situation, there is essentially one identity 
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to check, which, in Allison’s notation becomes 

[Va,l,Vb^c] = yVa,i{b),c — Vb,Va,l(c)- 

Allison shows there is a one to one correspondence between simple structurable 
algebras and certain symmetric five step gradings of simple Lie algebras. His 
constructions work over all fields and one motivation for his constructions 
was to determine simple Lie algebras over arbitrary fields. Our more general 
5-step constructions correspond to algebraic structures termed Kantor triple 
systems. 

Jordan triple systems form a special class of Kantor triple systems, those 
with trivial involution a = a and thus 5(A) = 0, and they give rise to the 
minuscule gradings our minuscule algorithm produces. 

2.5.3 Rigidity 

In contrast to the rigidity theorems in Section 2.1.1 we have: 

Theorem 2.14. There exist “fake” adjoint varieties. That is, for each adjoint 
variety X C Pg, there exists Z C P^, not isomorphic to X , U C Z a Zariski 
open subset, and a holomorphic map 4> : U ^ X such that asymptotic direc- 
tions are preserved {in fact the entire projective second fundamental form is 
preserved, see [60]). 

Moreover, the same is true for all non-minuscule homogeneous varieties. 

This local flexibility fails globally for adjoint varieties. Consider the fol- 
lowing result of Hong [42] : 

Theorem 2.15. A Fano manifold with a geometric structure modeled after 
a fundamental adjoint variety Z is biholomorphic to Z and the geometric 
structure is locally isomorphic to the standard geometric structure on Z. 

A geometric structure on a variety X modeled after a fundamental adjoint 
variety Z may be understood as follows. Tor all x € X, one has a subvariety 
Yx C VTxX isomorphic to the asymptotic directions C FT^Z. Note that 
here the subvariety Y^ is not required to play any particular role, but it must 
be present at every point so in particular it determines a family of distributions 
on X. 

Hong’s theorem is a variant of an earlier rigidity result of Hwang and Mok 
[45], where a geometric structure may be understood in the analogous way. 

Theorem 2.16. A Fano manifold with a geometric structure modeled after 
a compact irreducible Flermitian symmetric space S of rank >2 is biholomor- 
phic to S and the geometric structure is locally isomorphic to the standard 
geometric structure on S. 




Representation Theory and Projective Geometry 



85 



The work of Hwang and Mok (also see [44]) relies on studying an intrin- 
sic analog of the set of asymptotic directions. Namely a Fano manifold X is 
uniruled by rational curves, and, fixing a reference line bundle, one has a sub- 
variety Yx C f’TxX of tangent directions to minimal degree rational curves. 
They also study deformation rigidity of homogeneous varieties with Picard 
number one. It is worth remarking that in the case of Hermitian symmetric 
spaces [46], a key fact used in their proof is that T{Yx) C PT^X is linearly 
nondegenerate, i.e., the same condition we use in the minuscule algorithm. 

2.5.4 Normal Forms For Singularities 

In [4], Arnold classified the simple singularities. Like many interesting things 
in life they are in correspondence with Dynkin diagrams, in fact just the simply 
laced ones. He also gave normal forms in a minimal set of variables (two). It 
was also known (but evidently unpublished) that the simple singularities can 
be realized as degree three hypersurface singularities if one allows the number 
of variables to grow with the Milnor number. Holweck [41] has found a nice 
realization of these hypersurface singularities using a theorem of Knop [54] 
and the construction in Section 2.3. 

2.6 Why Secant and Tangent Lines? 

The idea that secant and tangent lines should so strongly control the geometry 
of homogeneous varieties was inspired by Zak’s theorem on Severi varieties. 

Theorem 2.17. (Zak’s theorems on linear normality and Severi varieties) Let 
X" C P"+“ be a smooth variety, not contained in a hyperplane and such that 
a{X) yf P”+“ Then 

(i) Q ^ 5 T 2. 

(ii) If a = § + 2 then X is one of t> 2 (P^) C P®, Seg(P^ x P^) C P®, 
G(2,6) C P^^ OP| C P26. 

The four critical varieties are called the Severi varieties after Severi who 
proved the n = 2 case of the theorem. 

It is not known if there is a bound on the secant defect Scr{X) := 
2n + 1 — dima(X) for smooth subvarieties of projective space with degen- 
erate secant varieties. On the other hand, Zak established an upper bound on 
the codimension of a smooth variety of a given secant defect. He then went 
on to classify the varieties achieving this bound, which he calls the Scorza 
varieties. They are all closed orbits G/P C PF, namely 'C 2 (P”), Seg(P" x P”), 
G(2, n) and OP^. 

Using Zak’s result, Ein and Shepherd-Baron proved these four varieties 
also classify quadro-quadro Cremona transformations [29] . There are numer- 
ous other characterization problems where the answer is the Severi varieties. 

Zak’s proofs of his theorems rely on looking at entry loci. Namely let 
X C PU be a variety and let y G PU\X. Define the entry locus of y to be 
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Sy {x & X \ 3z & X,y & pi^}. 

Here P^^.^ denotes the projective line spanned by x and 2 ;. Zak shows that for 
a Severi variety, the entry locus of a general point of ct(X) is a quadric hyper- 
surface in X . He then goes on to show that a variety so uniruled by quadric 
hypersurfaces and satisfying the dimension requirements must satisfy further 
dimension restrictions and eventually must be one of the four Severi varieties. 
More precisely, he shows that each Severi variety is the image of a rational 
map of a projective space. Our algorithms generalize his construction of the 
Severi varieties. 

Recently Chaput [15] has shown that such a uniruling by quadrics imme- 
diately implies homogeneity, which gives a quicker proof of Zak’s theorem. 

The rigidity results for the Severi varieties other than V 2 (J°'^), are an out- 
growth of a different proof of Zak’s theorem, where one first shows that any 
putative Severi variety infinitesimally looks like an actual Severi variety to 
second order at a general point, and then uses the rigidity to finish the proof. 
(w 2 (lP^) requires special treatment as its tangential variety is nondegenerate.) 
See [57] and [58]. 

Many other important problems are related to the geometry of secant 
varieties. Consider the classical Waring problem: given a generic homogeneous 
polynomial of degree d in n -I- 1 variables, what is the minimal k such that the 
polynomial may be written as a sum of k d-th powers? Phrased geometrically, 
the problem is to find the minimal k such that <Tfc(wd(]P")) = P(S''’*C"+^). This 
problem was solved by Alexander and Hirschowitz [1]. Generalizations and 
variants are still open, see [13, 47, 75] for recent progress. 

2.7 Tits Correspondences and Applications 

In Section 2.7.1 we describe a construction. Tits correspondences [81], to deter- 
mine the homogeneous (in the sense described below) unirulings of a rational 
homogeneous variety X C W. We explain how to use Tits correspondences to 
explicitly construct the homogeneous vector bundles over X in Section 2.7.2. 
In Section 2.7.3 we relate Tits correspondences to other orbit closures in ¥V 
and systematize Kempf’s method for desingularizing orbit closures. Tits cor- 
respondences led us to the decomposition formulas described in Section 4.2 
and we believe they will have more applications in the future. 

2.7.1 Tits Correspondences 

Tits associated to any simple group a full set of geometries, encoded by the 
parabolic subgroups and their relative positions. This culminated in the defi- 
nition of buildings, which has since known formidable developments. The Tits 
correspondences we now describe come from this perspective. 

Let G be a simple Lie group, let S, S' be two subsets of simple roots of G. 
Consider the diagram 
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G/ PsuS' 




X = G/Ps X' = G/Ps' . 

Let x' e X' and consider Y := 7r(7r'~^(x')) C X. We call Y = Y^' the Tits 
transform of xL The variety X is covered by such varieties Y. Tits shows that 
Y = H/Q where P{H) — T>{G)\{S\S'), and Q C iL is the parabolic subgroup 
corresponding to S'\S. We call such subvarieties Y oi X, G -homogeneous 
subvarieties. 

2.7.2 Unirulings 

Unirulings by lines. Let X = GjPa C PU be a homogeneous variety. In 
Theorem 2.5 above we determined the parameter space of lines through a point 
of X. Here we determine the space of all lines on X. Let Fi(X)*^ C G(2, V) C 
FA'^V denote the variety parametrizing the G-homogeneous P^’s on X. Then 
Fi(X)*^ = G/Ps where S is the set of simple roots adjacent to a in D{g). If 
P is not maximal, there is one family of G-homogeneous P^’s for each marked 
node. If a is not a short root, all lines are G-homogeneous. 

Unirulings by P^ ’s. The diagram for P* is (a^, wi). Here there may be several 
G-homogeneous families of P^’s on X = Gf Pa, each arising from a subdiagram 
of D{q,uj) isomorphic to a D{ak,uJi). If a is not short, then all P^’s on X are 
G-homogeneous . 

Example 2.18. The largest linear space on En/Pi is a P"“^, via the chain 
terminating with a„, so En/P\ is maximally uniruled by P"“^’s. There is a se- 
cond chain terminating with 02 , so En/P\ is also maximally uniruled by P'^’s. 
(The unirulings by the P'^’s are maximal in the sense that none of the P"^’s of 
the uniruling are contained in any P® on En/ P\.) The varieties parametrizing 
these two unirulings of En/Pi are respectively En/P 2 and EnjPb- 



Oil Oil 




Unirulings by quadrics. Here we look for subdiagrams isomorphic to the dia- 
gram of a quadric hypersurface, i.e., U(so„,wi). Note that there are at most 
two possible such subdiagrams except for the case of (g, V) = (sos, Vu,^) where 
there are three isomorphic ones. 

Example 2.19. (g, V) = (s 02 m, has two such unirulings, by Q'^’s para- 
metrized by Dm/Pak- 2 ,ak +2 by parametrized by Dm/Pak-i- 
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ak \o ak \o 



Example 2.20. (The Sever! varieties) The G-homogeneous quadrics uniru- 
ling the Sever! varieties are parametrized by the same Sever! variety in the 
dual projective space. 

o • o ® O • o o o ® 

G(2,6) 6 OP^ 

Unirulings by quadrics give rise to subvarieties of (j{X) as follows. The 
union of the spans of the quadrics produce a subvariety of (t(X) whose en- 
try loci contain the quadrics (and in all examples we know, are equal to the 
quadrics). It also appears that, when X is homogeneous, these give the sub- 
varieties of cr{X) with maximal entry loci. As explained below, these orbit 
closures admit uniform desingularizations by Kempf’s method. 

2.7.3 Homogeneous Vector Bundles 

The G-homogeneous vector bundles over rational homogeneous varieties Z = 
G/Q are defined by Q-modules. (We change notation to reserve G/P for 
a different role below.) If tU is a Q-module, one obtains the vector bundle 
Ew := GxqW ^ G/Q where {gp, w) ~ (g,pw) for all p G Q. Note that ZJ(f) 
is D{q) with the nodes corresponding to Q deleted. 

Some homogeneous vector bundles over rational homogeneous varieties 
Z = G/Q can be understood in terms of Tits fibrations. Let X = G/P C W. 
For each z G Z we obtain a variety C X and thus a linear space (Yz) C V. 
As we vary z, we obtain a vector bundle E ^ Z whose fibers are the {Yz)’s. 
In particular, if is a subbundle of the trivial bundle V 0 Oz Z. 

2.7.4 Collapses a la Kempf 

Let X = G/ P C PV be a rational homogeneous variety. In [53], Kempf defined 
a method for desingularizing orbit closures G C PU by finding a vector bundle 
over a different homogeneous space Z = G/Q. He calls this technique the 
collapsing of a vector bundle. He gave some examples that appear to be found 
ad hoc. In [61] we gave new examples of collapsing occurring in series. Using 
the above discussion, we now give another description of Kempf’s method. 

Recipe For Kempf’s Method 

Let U be a G-module with closed orbit X C PU. Let Z = G/Q be a rational 
homogeneous variety of G, defining a Tits correspondence with X. 
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Consider the G- variety, which often appears to be an orbit closure 
0 = U, 6 z(n) CPC. 

If G yf ¥V, then G is a singular variety. It admits a desingularization by 
¥E, where E ^ Z is the vector bundle constructed above as the natural map 
Pi? ^ Z is generically one to one. 

Note that the G- variety t{X) is of course desingularized by ¥TX, which 
is a special case of the above with Q = P. 



3 Triality and Exceptional Lie Algebras 

We begin with a review of division algebras via the Cayley-Dickson process 
in Section 3.1 and explicitly describe the derivations of O in Section 3.2 for 
later use. In Section 3.3 we review the triality principle for the octonions and 
its extension to all structurable algebras. We pause for a detour in Section 
3.4, exploring the triality model for SO 44 in detail, which ends up being a 4- 
ality. We review various constructions of the magic square in Section 3.5. We 
present a new result regarding the compatiblity of the Cayley-Dickson process 
and inclusions of triality algebras in Section 3.6, which at first glance appears 
to be trivial, but whose “obvious” generalization to structurable algebras is 
false. In Section 3.7 we study automorphisms related to the algebras in the 
magic square and the resulting magic squares of symmetric and trisymmetric 
spaces. In Section 3.8 we use our result in Section 3.6 to show how some towers 
of dual pairs naturally occur in series. In Section 3.9 we discuss quaternionic 
symmetric spaces, their relation to adjoint varieties and the conjecture of 
LeBrun and Salamon. 

3.1 Division Algebras 

A classical theorem of Hurwitz, published in 1898, asserts that there are only 
four normed division algebras over the field of real numbers: K itself, C, the 
quaternions H, and the octonions O. A division algebra is an algebra without 
zero divisor and a normed division algebra is a division algebra endowed with 
a norm such that the norm of a product is the product of the norms. 

Quaternions were discovered by Hamilton in 1843, and octonions shortly 
afterwards by Graves and Cayley. A nice way to define these algebras is to 
imitate the definition of complex numbers by a pair of real numbers. Let A 
be a real algebra endowed with a conjugation x ^ x, such that x + x and 
XX = XX are always real numbers (more precisely scalar multiples of the unit 
element), the later being positive when x is nonzero. If A is alternative, i.e., 
any subalgebra generated by two elements is associative [5] , then A is a normed 
algebra for the norm ||x|p = xx. 

One can then define a new algebra with conjugation B = A 0 A by letting 
{x,y){z,t) = (xz — ty,xt + zy) with conjugation (x,y) = (x,—y). This is 
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the Cayley-Dickson process. The new algebra B will be alternative, hence 
a normed algebra, iff A is associative. 

In particular, A = C gives the quaternion algebra B = H, which is asso- 
ciative, so the Cayley-Dickson process can be applied once more and A = H 
gives the octonion algebra B = O. This algebra is no longer associative (al- 
though it is alternative, hence normed), and the process then fails to produce 
new normed algebras. 

A useful variant of the Cayley-Dickson process is obtained by changing 
a sign in the formula for the product in B, letting (x,y){z,t) = (xz+ty,xt+zy). 
The resulting algebra B is called split. It is no longer normed, but endowed 
with a nondegenerate quadratic form of signature (a, a) compatible with the 
product. (Here a denotes the dimension of A.) In particular, it is a composition 
algebra. The algebra C of split complex numbers is the algebra M0]R with 
termwise multiplication, while the split quaternion algebra H is equivalent to 
M2(R). 



3.2 Derivations 

Any automorphism of H is inner, so that any derivation of H is of the form 
La — Ra for some imaginary quaternion a S ImH, where La and Ra denote the 
operators of left and right mulplication by a. In particular DerH = ImH = SO3. 

The derivation algebra of O is the compact Lie algebra g2- The algebra 
DerH = SO3 does not imbed in DerO in a canonical way, but there is one 
prefered embedding for each decomposition O = H 0 eH, where the product 
in O is deduced from that in H through the Cayley-Dickson process. Indeed, 
for (j) G DerH, the endomorphism 0 of O defined by 0 (x + ey) = 4 >{x) + e 0 (y) 
is a derivation. Note that the subalgebra Der( 0 ,H) of the derivations of O 
stabilizing H is strictly greater than DerH. It contains, for each imaginary 
quaternion h, the map iphix + ey) = e{yh). This gives another copy of SO3 
in Der( 0 ,H) = SO3 x SO3, and the restriction of these derivations to eH gives 
the full SO4 = SO3 X SO3. Explicitly, choose a standard basis cq = 1 , ei, e2, 
63 = 6162 of H, and let 64 = e, es = eei, 6 q = ee2, 67 = ee^. Using this basis 
of O, we obtain a matrix representation of 92 = Der(O): 



/O 0 


0 


0 


0 


0 


0 


0 


\ 


0 0 


— 0'2 


— «3 


—ai 


—ae 


—ae 


— 0^7 




0 02 


0 


-Ps 


~Pi 


~Pb 


—Pe 


-Pr 




0 03 


Ps 


0 


<xe + Pe 


—ae — Pi 


— 04 0 Pr 


ar — Pe 




0 0:4 


Pi 


—ae — Pe 


0 


-75 


-76 


-77 




0 05 


Pb 


C^5 + Pi 


75 


0 


—02 0 77 


-«3 - 76 


0 ae 


Pe 


0:4 — Pr 


76 


02 — 77 


0 


Ps 0 75 




yO 07 


Pr 


—ar + Pe 


77 


0:3 0 76 


~Pe — 75 


0 


J 



It follows that the Lie sub-algebra Der( 0 , H) may be written: 
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000000 0 0 
0 0 -«2 -«3 0 0 0 0 

0 «2 0 -/?3 0 0 0 0 

0 «3 /?3 0 0 0 0 0 

0 0 0 0 0 -75 -76 -77 

0 0 0 0 75 0 — «2 + 77 — «3 — 76 

0 0 0 0 76 «2 — 77 0 (iz + lb 

0 0 0 0 77 «3 + 76 -/?3 - 75 0 

Our first type of derivations in Der(0,H) corresponds to those matrices 
for which 75 = 76 = 77 = 0, and the second type to those for which «2 = 
013 = (iz = 0. These two copies of SO3 commute. Finally, the south-east corner 
of the matrix above gives a copy of SO4. 

3.3 Triality 

3.3.1 Cartan’s Triality 

The Dynkin diagram of type 774 is the only one with a threefold symmetry: 



o 

o 

Symmetries of Dynkin diagrams detect outer automorphisms of the corre- 
sponding complex (or split) Lie algebras, and in the case of this is closely 
related with the algebra structure of the octonions. Indeed, let 

T(0) = {(Ui,U2,U3) G SO(0)3 I Ui(xj/) = U2(x)U3(y) Vx,y G O}. 

This group contains Aut(O) = G2 and has three projections tti, 7T2, 773 on 
SO(0), hence three representations of dimension eight. The following theo- 
rem is due to Elie Cartan and can be found page 370 of his paper [10] from 
1925. Define Sping to be the compact, simply connected Lie group with Lie 
algebra sos. 

Theorem 3.1. The group T(0) is Spiug, and each projection tt* is a twofold 
covering of SOs- The three corresponding eight dimensional representations 
of Spiug are not equivalent. 

With this description of Sping in hand, it is easy to define an action of ©3 
by outer automorphisms. Indeed, since O is alternative and x = —x modulo 
the unit element of O, the relation x{xy) = (xx)y holds. (This and similar 
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identities are due to Moufang, see [39].) A little computation then shows that 
the identities 

Ui(a;y) = U 2 (x)U 3 (j/), ll 2 (x?/) = Ui(x)U 3 (y), U 3 (xy) = U 2 (x)Ui(j/) 

are equivalent. If we denote by r G S0(0) the conjugation anti-automorphism, 
this implies that we can define automorphisms s and t of Spiug by letting 



s(Ui,U 2 ,U 3 ) = (U 2 ,Ui,roU 3 or), 

^(Ui, U2, U3) = (r o Ui o r, r o U 3 o r, r o U 2 o r). 

These automorphisms are not inner, since they exchange the three inequivalent 
eight dimensional representations of Spiug. Moreover, we have = 1 

and sts = tst, so that s and t generate a group isomorphic to © 3 , which is 
the full group of outer automorphisms of Spiug. 

Note that at the level of Lie algebras, Cartan’s theorem above implies the 
infinitesimal triality principle, which we state as 

t(0) := {(^ 1 ,^ 2 , U 3 ) € so(0)^ I ui(xy) = U 2 (x)y + xusiy) Vx, y G O} = sog. 

This means that if we fix u\ for example, there is a unique pair of skew- 
symmetric endomorphism of O such that the above relation holds. 



3.3.2 Triality Algebras 

Allison and Faulkner [3], following work of Allison [2] and Kantor [50] define 
the following vast generalization of the triality principle. Let A be any algebra 
with unit and involution a i-^- a over a ring of scalars. Let ImA = {a G A, a = 
—a}. Define the triality algebra of A 

t(A) :={T=(Ti,T2,T3)Gfl[(A)®3 |7Y(a6)=T2(a)& + aT 3 ( 6 ) Va, 6 GA}, 

with Ti(a) = Ti(a). This is a Lie subalgebra of In [3] it is call the 

set of partially related Lie triples of A. If 3 is invertible in the ring of scalars, 
they provide (Corollary 3.5) a general description of t(A), which in the case 
where A is alternative gives 

t(A) = {{L) Lg — Rt, D -\- Lt — D -\- Lr — Rg) \ D G Der(A), 

r,s,t G Im(A), r -I- s -I- t = 0} 

= Der(A) 0 Im(A) ® 

If D is a derivation, {D, D, D) G t(A) because D = D. Also, recall that A 
being alternative means that any subalgebra generated by two elements is 
associative, or equivalently, that the associator 



{x,y,z} := {xy)z - x{yz), x,y,zeA, 
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is a skew-symmetric trilinear function. In particular, we have {x, y, z} = 
{z,x,y}, which can be rewritten as {xy)z + z{xy) = x{yz) + {zx)y. If 0 is 
imaginary, this shows that {—Lz — Rz,Lz,Rz) is in t(^). Using the triality 
automorphisms defined above, one gets that {Lg — Rt, Lf — Rr, Lr — Rg) belongs 
to t(^) as soon as r, s, t are imaginary with r + s + t = 0. 

For composition algebras, we get 



t(K) = 0 , 

t(C) =]R2^ t(C) =]R2, 
t(H) = (so3)®^ t(H) = (s[2)®^ 
t( 0 ) = sos, t( 0 ) = SO 44 . 

3.4 Triality and 304,4: 4 -ality 

An interesting version of triality holds for 304,4, the split version of sog- We 
use a model is related to the fourfold symmetry of the extended Dynkin dia- 
gram £>4: 



^4 




Choose four real two-dimensional vector spaces A, B, C, D and non-dege- 
nerate two-forms on each of them. Then 

304,4 = X sl{B) X 3((C) X sl(D) 0 {A® B ®C ® D). 

In this model, 31(A) x 31(B) x 3l(C) x 31(B) is a sub-Lie algebra and acts on 
A®B®C®Din the obvious way. The bracket of two vectors in A®B®C®D 
can be defined as follows. Choose non-degenerate skew-symmetric two forms 
on A, B, C and D. We denote these forms by the same letter to. We have then 
natural isomorphisms S'^A sl(A), and so on, by sending a square a? , where 
a G A, to the endomorphism a' i-^- oj(a, a')a. With this understood, we let 

[a ® b ® c® d, a ® b' ® c ® d'] 

= uj{b, b')Lo{c, c')uj{d, d')aa' + co(a, a')aj(c, c')Lo{d, d')bb'+ 

+ uj{a, a')u){b, b')uj{d, d')cc' + co(a, a')uj{b, b')uj{c, c')dd' . 

One can then check that the Jacobi identity holds, so that we obtain a Lie 
algebra which can easily be identified with 304,4. One could also take in 004,4, 
once a Cartan subalgebra and a set of positive roots have been chosen, the 
product of the four copies of 3I2 generated by the three simple roots and by 
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the highest root. These four copies commute, and the sum of the other root 
spaces forms a module over their product. It is then routine to identify this 
module with the tensor product of the natural representations. 

What is particularity nice with this model is that we can explicitly define 
three inequivalent eight dimensional representations, which we denote by 

61 = (A'^B) © (C(g)£>), 

62 = {A(g)C) © {B(g)D), 

63 = {A®D) © {B®C). 

The action of SO44 is easy to describe: the action of s((A) xsl(i?) xs[(C) xs\{D) 
is the obvious one , while that of A © i? © C © U on Oi, for example, is defined 
by 

a®b®c®d.{a! ®b' + c' ®d!) = uj{c, c')w(d, d')a®b + oj(a, a')oj(b, b')c0d. 

To see that we get three inequivalent representations, we can describe the 
root system of SO44 thanks to the previous model, and check that the high- 
est weights are distinct. Moreover, once isomorphisms of A, B, C and D with 
a fixed two-dimensional vector space have been chosen, there is an obvious 
action of the symmetric group ©4 on SO44 and its triplet of representations. 
The resulting group of outer automorphisms is only 63, of course, which in 
this model appears as the quotient of ©4 by the normal subgroup of order four 
whose three nontrivial elements are products of disjoint two-cycles (recall that 
the alternating group A4 is not simple!). (See [55] for a geometric interpreta- 
tion of the 504^4 triality, and an application to the construction of a minimal 
unitary representation.) Note also that the subalgebra of fixed points of the 
©3-action (defined by the permutations of A, B, C) on SO44 is 

02 = sl(^) X sl{D) © (S^A^D), 

the split form of 92. 

As pointed out by J. Wolf in [34], one can twist this ©3-action so as 
to get a different fixed point subalgebra. We define automorphisms r and 
r' of SO44, acting on (M, N, P, Q) G sl(A) x s[{B) x sl(C) x s[{D) and on 
a^b^c^d G A0 B 0 C 0 D in the following way: 

t{M, N, P,Q) = {P, M, N,Q), T{a0b0c0d) = a0b0c0d, 

t'{M, N, P,Q) = {P, M , N , ad{T)Q) , T'{a0b0c0d) = c0a0b0T{d), 

where T is a rotation matrix of order three (so that + T + 1 = 0) . The fixed 
point set of r' is sl(A) x RiL © M, where H = 1 + 2 T and M is the space of 
fixed points of r' inside A0 B 0 C 0 D. Write such a tensor asA©e + y©Te 
for some nonzero vector e in ZJ, where X and Y belong to A0 B 0 C . It is 
fixed by t' if and only if A = —t{Y) and (1 + r + r^)(F) = 0, which means 
that Y = Z — t{Z) for some Z, and then X = t^{Z) — t{Z). In particular 
M has dimension 4 and it is easy to see that the space of fixed points of r' is 
a copy of SI3. 
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3.5 The Magic Square 
3.5.1 Jordan Algebras 



The relation between exceptional Lie groups and normed division algebras, 
especially the octonion algebra, was first noticed by E. Cartan, at least as early 
as 1908 (see the encyclopedia article for the French version of the Mathema- 
tische Wissenschaften) . Cartan observed that the automorphism group of O is 
the compact group G2. In 1950, Chevalley and Schafer obtained the compact 
group E4 as the automorphism group of the Jordan algebra 




This is an algebra with product A.B = ^{AB + BA). It is a commutative but 
nonassociative algebra, in which the characteristic identity A^{AB) = A{A^B) 
of Jordan algebras holds. By remarks in [12], it appears Cartan was aware of 
this construction at least as early as 1939. 

Jordan algebras were introduced in the 1930’s by Jordan, von Neumann 
and Wigner as a natural mathematical framework for quantum theory. Any 
associative algebra (over a field of characteristic not equal to 2) can be consi- 
dered as a Jordan algebra for the symmetrized matrix product a.b = ^{ab + 
ba). A Jordan algebra is said to be exceptional if it cannot be embedded 
as a Jordan subalgebra of an associative algebra. The algebra 1/3(0) is an 
exceptional Jordan algebra. Moreover, if A is an algebra such that Jn{A), 
with its symmetrized product, is a Jordan algebra, then A must be alternative 
if n > 3, and associative if n > 4. 

The closed orbits X C Jn{A), with A the complexification of a division al- 
gebra are exactly the Scorza varieties while the Sever! varieties are exactly the 
varieties X C 173(A), see [85]. The close relationship between Scorza varieties 
and Jordan algebras, which is not explained in [85], is investigated in [16]. 



3.5.2 The Preudenthal Tits Construction 

The discovery that F4 = Autl/3(0) led several authors (including Freudenthal, 
Tits, Vinberg, Jacobson, Springer) to study the relations between exceptional 
groups and Jordan algebras. Freudenthal and Tits obtained a unified con- 
struction of all compact exceptional Lie algebras in the following way: take 
two normed division algebras A and B, and let 

g(A,B) := DerA 0 (ImA 0 173(8)0) 0Derl73(B), 

where l73(B)o C 1/3(8) is the hyperplane of traceless matrices. One can then 
define a Lie algebra structure on g(A,B), with DerA 0 Derl73(B) as a Lie 
subalgebra acting on ImA 01/3(8)0 in a natural way [79]. The result of this 
construction is the Freudenthal- Tits magic square of Lie algebras: 
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Let B = 0 denote the zero algebra, so J„(0) ~ C" is the diagonal matrices. 
Let A be something slightly smaller, so that Jn{A) C Jn(0) consists of the 
scalar matrices. With these conventions, we obtain a magic rectangle: 
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3.5.3 The Allison Construction 

While it is impressive that the vector space g(A,B) is a Lie algebra, the 
symmetry of the square appears to be miraculous. Vinberg, in 1966 , obtained 
a symmetric construction (see [ 72 ] for an exposition). We present a variant 
of the Vinberg construction first discovered by Allison [ 2 ], then rediscovered 
independently in more geometric form by Dadok and Harvey [ 23 ] (who, after 
discovering Allison’s work decided not to publish their manuscript). Barton 
and Sudbery [ 7 ], and ourselves [ 62 ]. 

Allison shows that given an arbitrary structurable algebra A, one can put 
a Lie algebra structure on 

t(A)0A®^ . 

Allison observes moreover that the algebra A = A(g)B with A,B division 
algebras is structurable and his construction applied to them yields the triality 
model, see [ 2 , 3 ]. 

Using the Allison construction, the magic square may be described as 
follows: 



g(A,B) = t(A) X t(B)0(Ai(g)Bi)0(A2(g)B2)©(A3(g)B3). 

This bracket is defined so that t(A) x t(B) is a Lie subalgebra, acting on each 
hi 0Bi in the natural way. The bracket of an element oi 0 &i G Ai 0Bi with 
02 0 62 G A2 0 B2 is simply 0302 0 61&2, considered as an element of A3 0 B3. 
This is the general rule for taking the bracket of an element of Aj 0 B^ with 
one of Aj0Bj, although there are some slight twists whose details can be 
found in [ 3 ] or [ 62 ]. Finally, the bracket of two elements in A^ 0B^ is defined 
by the quadratic forms on Aj, Bj and the natural maps iFj : A^Aj ^ t(A) 
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obtained by dualizing the action of t(A) on A^, which can be seen as a map 
t(A) ^ Ai. (Note that t(A) is always reductive, hence isomorphic to its 
dual as a t(A)-module.) The key formulas that ensure that the Jacobi identities 
hold in g(A,B) are then the following, which we state only for 'Fi: 

Fi{u Av)ix = Q{u, x)v — Q{v, x)u, 

Fi{u A v)2X = h{v{ux) — u{vx)), 

Fi{u A v)3X = -^{{xu)!! — (xv)u). 

These formulas are classical in the study of triality, that is for A = O. It is 
easy to check that in the other cases, which are much easier, we can arrange 
so that they also hold. 

Proposition 3.2. The real Lie algebra g(A,B) is compact, while g(A,B) is 
split. 

Proof. Let ATa be the non-degenerate quadratic form on t(A) which we used 
in the construction of g(A,B). For A = O, this form is the Killing form on 
sog and is therefore negative definite; this is also true for the other division 
algebras. Now it is easy to check that the quadratic form 

3 

Q := Ka + Km — ^ Qa, Qsi 

i=l 

is invariant and negative definite. Since g(A,B) is simple (except for A = 
B = C), this invariant form must be proportional to the Killing form, which 
is therefore negative definite as well (it cannot be positive definite!). Thus 
g(A,B) is compact. 

Finally g(A,B) is clearly split since both t(A) and t(B) are split, and their 
product is a maximal rank subalgebra of g(A,B). □ 

3.6 Inclusions 

It is not at all obvious that an inclusion B C B' of composition algebras induces 
an inclusion g(A,B) C g(A,B') of Lie algebras. In fact the Allison-Faulkner 
process applied to structurable algebras A C B does not imply inclusions 
g(A) C q{B). To discuss this problem in our situation we may assume that 
B' = B 0 eB is deduced from B via the Cayley-Dickson process. 

Theorem 3.3. There is a unique embedding of Lie algebras t(B) ^ t(B') that 
makes g(A,B) a Lie subalgebra o/g(A,B'). 

If B' is deduced from B by the Cayley-Dickson process, the relevant em- 
bedding o/t(B) inside t(B') is 



t(B) ~ {(C/i, C/2, C/3) G t(B') I C/,(B) c B} c t(B'). 
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Proof. We want the inclusion g(A,B) ^ g(A,B') to be a morphism of Lie 
algebras. It is easy to see that the only non-obvious verification to be made 
is that the bracket of two elements in Aj(g)Bi is the same in g(A,B) as in 
g(A,B'), which amounts to proving that we have a commutative diagram 

A2(Ai(g)B,) — > t(A) X t(B) 

i i 

A2(Ai®B') — > t(A) X t(B'). 

Since the norm on B is the restriction of the norm on B', it is actually enough 
to prove the commutativity of the following diagram: 

A^B, ^ t(B) 

i ^ i 

A^B' ^ t(B'). 

We must check this for all i, so we consider the sum : A^Bi 0 A^ 
B 2 0 A^Bs — > t(B). Note that 'Fm is dual to the action, hence surjective since 
the action map is injective by definition. So the commutativity of the diagram 
above for i = 1,2,3 completely determines the inclusion of t(B) inside t(B'). 
For this inclusion map to be well-defined, we need a compatibility condition, 
namely that Kerifa C KertpR'. Everything being trivial for B = K, we will 
check that KeriFc C KeriFn C Ker!Fo and deduce the relevant embeddings 
t(C) C t(H) c t(0). 

We begin with <Fc, which is dual to the inclusion map 

t(C) = {(a, 6 , c) G I a=b+c} C A^Ci 0 A^ C 2 0 A^ C 3 , 

where for example a G K maps to the skew-symmetric endomorphism 
of Cl. On t(C) we use the restriction of the canonical norm of and we find 
that the dual map is 

T f f 0 a\ f 0 b\ / 2 a 060 c a 0 2 & — c a — b+2c\ 

^-aojd-tojd-coj j"( — 3 — • — 3 — ■ — 3 — )■ 

whose kernel is generated by ^ ■ (? V) ) ■ 

Now to compute >%, using that Der(H) ~ ImH we may describe t(H) as 

t(H) = {{La 0 Rb, La — Rc, La 0 Rb) \ Q,b,c G ImH}. 

Every skew-symmetric endomorphism of H is of the form L^ + Ry for some 
imaginary quaternions x and y, and the norm defined by the Killing form is 
\\Lx 0 RyW"^ = ||a;|P 0 ||j/|P- With the induced norm on t(H) we compute that 

Fb ■ {Lxi 0 Ryi , L X2 + Ry2 1 ^X3 0 Rya ) 

^ {Lxi+x3 0 Ryi+y2} Lxi+X 3 ~ Rx2 — y3^ ^X2 — y3 “k ^yi+y2)- 
Its kernel is {{Lx + Ry, L^ — Ry, —Lx + Rz) \ x,y,z G ImH}. 
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Finally, the computation of ^<o is an immediate consequence of the triality 
principle. Indeed, we know that each projection t( 0 ) ^ is an isomor- 

phism. If we denote by {U, U' , U") the elements of t( 0 ), this means that such 
a triplet is uniquely determined by U, U' or U” . We deduce that 

■■ {Uu U^') ^ + U2 + C/3, C/{ + C/' + C/', C/f + C/" + c/"). 

We are ready to check our compatibility conditions. First note that the 
endomorphism of C, when extended to H in the obvious way, is 1 A i = 

I (Li -I- Ri). Taking x = y = —z = im our description of KeriLn, we see that 
it contains KerlLc, as required, and that the induced inclusion t(C) C t(H) is 
given by 

(6, c) G 1-^ (L(b+2c)i + R{2b+c)it i(&+2c)i + R(c-b)i: L(p_c)i + R{2b+c)i)- 

Now take {L^ + Ry, — Ry, —L^ + Rz) in KeriLn, where x,y,z G ImH, 
and consider it as an element of A^Oi 0 A^ O2 © A^ O3, which we denote by 
{{Lx + Ry, 0 ), {Lz — Ry, 0 ), {—Lx + i?z, 0 )). Here (L^, 0 ), for example, denotes 
the endomorphism of O defined on elements of H by left multiplication by 
0 G H, and by zero on H-*-. Note that with these conventions, it follows from 
the multiplication rules in the Cayley-Dickson process that for 2; G ImH, we 
have Lz = {Lz,-Lz) and Rz = {Rz,Lz). 

It is easy to check that every skew-symmetric endomorphism of H is of the 
form La + Rb- In matrix terms, if a = a\i + 02j + a^k and b = (3\i + ^2j + Psk, 
we have 



C 0 —a\ —02 — Q!3\ 

CXi 0 — O3 CX2 

CX 2 03 0 — CX\ 

y03 —02 Oi 0 / 



Rb = 



( 0 —Pi —P2 —Ps^ 
Pi 0 Ps P 2 
P 2 —Ps 0 Pi 
\P3 P 2 —Pi 0 j 



Under the natural isomorphism so(H) ~ A^H induced by the norm on H, this 
means that 



La = oi(1ai 0 jf\k) + 02(1aj 0 kf\i) 0 03(lAfc 0 if\j), 

Rb = / 3 i( 1 ai — jAfc) 0 /32(1 aj — kAi) + Ps{lAk — lAj). 

Now we can ask what is the element of t( 0 ) defined by ui = Iaz G so(H) C 
so( 0 )? To answer this question, we just need to note that Iai = ^{Li + Rp, so 
U2 = \Li and = ^Ri- Also if we take ui = ja/c, a straightforward computa- 
tion gives U2 = jAk 0 ^Ri = ^{Li,Lp and W3 = ja/c — ^Li = ^{—Ri, Lp. Let- 
ting automorphisms of H act, we deduce that the following triplets {ui,U2, up 
belong to t(0), where z,u,v denote imaginary quaternions: 
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Thus we have 

tf'o((i.,0),0,0) = ((L,,0),(0,-L,),(L,,0)) = <f'o(0,0,(T,,0)), 
tZ'o((i?y,0),0,0) = ((i?j,,0),(i?j„0),(0,Lj,)) = tf'o(0,(i?y,0),0), 

<P'o(0, (T., 0), 0) = ((0, -L,), (L„ 0), (-i?„ 0)) = <P'o(0, 0, (-i?„ 0)). 

This immediately implies that {{L^ + Ry, 0), {L^ — Ry, 0), {—L^ + -Rz, 0)) 
belongs to Ker'Z'oj and we deduce from the preceding formulas that the induced 
imbedding of t(H) C t(0) is given by 

{La + Rb, La — Rc, La + Rb) € t(IH) 

{{La + Rb, Lc), {La — Rc, —Lb), {La + Rb, La)) € t(0). 

In particular, one can check that as a subalgebra of t(0), t(C) is generated by 
{Li “t“ Ri , Li , Ri) and {Ri , Ri , Li -\- Ri) . 

A more careful inspection of these formulas yields the explicit conclusion 
stated in the theorem. □ 

3.7 Automorphisms, Symmetric and Trisymmetric Spaces 

The symmetry in the triality model in the roles of A and B allows one to 
exhibit automorphisms of exceptional Lie algebras with interesting properties. 
For example: 

Proposition 3.4. [62] The endomorphism o/g(A,B) defined as the identity 
on f)(A,B) = t(A) X t(B) 0 Ai0Bi, and minus the identity on A 20 B 2 © 
A 30 B 3 , is a Lie algebra involution. 

Exhibiting a Lie algebra involution or a symmetric space is more or less 
equivalent, and we conclude that there exists a “magic square” of symmetric 
spaces of dimensions 2ab where a and b denote the dimensions of A and B. In 
particular we always get powers of 2! These are not all uniquely defined by 
our Lie algebra involution, but a version of this magic square is the following: 
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The symmetric space i?8(8) = As/SOig, of dimension 128, is particularly in- 
triguing and it would be very nice to have a direct construction of it. It is 
claimed in [76] that it can be interpreted as a projective plane over O ©O, and 
that in fact the whole square above of symmetric spaces can be obtained by 
taking projective planes, in a suitable sense, over the tensor products A©B. 

It is also easy to describe Lie algebra automorphisms of order three, reflect- 
ing the trialitarian origin of the magic square. Recall that t(A) has a natural 
automorphism ta or order three. 
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Proposition 3.5. The endomorphism o/g(A,B) defined by 

ta,b(^ + r+Ui + [/2 + [/ 3 ) = ta(X) + tb(F) + [/2 + c/3 + C/i 

for X G t(A), V G t(B), Ui G Aj (g)Bi, is a Lie algebra automorphism of order 
three, whose fixed points set is the subalgebra 

t(A,B) = DerA x Z?erB0A(g)B. 

When B = O, the conclusion also holds when we replace the usual triality 
automorphism to by its twisted version Tq. In this case, the fixed point set is 
the subalgebra £'(A,B) = DerA x su3©A(g)B. 

As in the case of involutions, we deduce from this statement a “magic 
square” of homogeneous spaces which are no longer symmetric, but are some- 
times called trisymmetric: they are quotients of a semisimple Lie group G by 
a subgroup K which is, up to a finite group, the fixed point set of an auto- 
morphism of G of order three. Their dimensions are equal to 2o6-|-2a-|-26 — 4. 
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Here we denoted by F4, Ag, A7, Ag the compact centerless groups of these 
types. Note that for example, U3/U1 x Ui x Ui is the variety of complete 
flags in C^. Similarly, U6/U2 x U2 x U2 is the flag variety F(2,4, 6). Also 
SO12/U4 X SO4 is the space of 8-dimensional subspaces in endowed with 
an orthogonal complex structure. This is because S02n acts transitively on 
the space of orthogonal complex structures. Moreover, the stabilizer of a point 
is the group of orthogonal transformations commuting with the corresponding 
complex structure, and this subgroup of S02n is a copy of U„. 

In the twisted case, for B = O, we replace the last line by 

F4/(SU3 X SU3/Z3) A6/(SU3 X SU3 X SU3/Z3) At/(SU3 X SU6/Z3) Ag/SUs X As, 

a series of trisymmetric spaces of dimension 18a -I- 18. Note that at the in- 
flnitesimal level, we obtain the quotients g(A,0)/sU3 x g(A,C). 

Automorphisms of order three were studied and classified by Wolf and 
Gray [34]. In the exceptional cases the construction above is not far from 
giving the whole classification. 

3.8 Dual Pairs 

The triality model allows one to identify series of dual pairs in the exceptional 
Lie algebras. Recall that a pair ((), ()') of Lie subalgebras of a Lie algebra g 
is a dual pair if Ij is the centralizer of t)' and vice versa. Dual pairs of Lie 
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algebras, or of Lie groups (with the same definition), have been extensively 
studied after the discovery by R. Howe that certain dual pairs of groups inside 
the real symplectic group Sp(2n, K) have very special properties with respect 
to the (infinite dimensional) metaplectic representation [43]. 

First recall that, as we saw in 4.7, the triality model is compatible with 
inclusions, in the sense that g(A,B) is naturally embedded in g(A',B') when 
A C A' and B C B'. 

Proposition 3.6. The centralizers in g(A,0) of the subalgebras g(A,H), 
g(A,C), g(A,R) and t(A), are isomorphic to SU 2 , SU 3 , 32 and j(t(A)) x sog, 
respectively. Moreover, the centralizers of these centralizers are the subalgebras 
themselves. 

Here we denoted by j(t(A)) the center of t(A), which is t(A) itself when 
this algebra is commutative, that is for A = K or C, and zero otherwise. 

Proof. It is easy to see that the centralizer of g(A,B) inside g(A,0) is a sub- 
algebra of t(0), equal to the subalgebra of the centralizer of t(B) inside t(0) 
acting trivially on each B^ C O^. 

If B = R we get the subalgebra of elements (mi,M 2 ,W 3 ) G t(0) killing the 
unit element in each O^. Making x = 1 and y = 1 in the triality relation 
u\{xy) = U 2 {x)y + xu^{y), we see that u\ = U 2 = W 3 is a derivation of O, so 
that the center of g(A,R) inside g(A,0) is DerO = g 2 . 

When B = C, the condition that (ui,U 2 , U 2 ) kills C Oi implies that u = 
ui = U 2 = U 3 is a derivation of O such that u{i) = 0 (i = ei in the notations of 
5.1). But then u{ix) = iu{x), which means that m is a complex endomorphism 
of C"'" ~ C^, endowed with the complex structure defined by Li (and also 
that defined by Ri, which is the conjugate complex structure, since u{xi) = 
u(x)i). Note that the corresponding element of t(0) automatically centralizes 
t(C), since u commutes with Li,Ri and we saw that t(C) is generated as 
a subalgebra of t(0) by {Li + Ri,Li, Ri) and {Ri, —Ri, Li + Ri). Finally, take 
the general matrix of g 2 as written in Section 3.2. The condition that u{i) = 0 
means that «2 = <^3 = 04 = 05 = oe = ay = 0. A complex basis of the space 
C'*' is (c 2 , 64 , ee), in terms of which u is the complex endomorphism given by 
the matrix 

/ iPs -Pi + iPs -Pe + iPr \ 

Pi + iP^ 175 -76 + *77 , 

\Pe + iPr 76 + *77 -i{Ps + 7s) / 

which is a general element of SU3. 

Finally let B = H. Again, our description of g 2 in Section 3.2 shows that 
the derivations of O vanishing on H form a copy of SO3, which we can describe 
as the space of endomorphisms of the form (0, i?z) with z € ImH. But we 
saw that t(H), as a subalgebra of t(C), was generated by the triplets {{La + 
Rb, Lc), {La — Rc, —Lb), {Lc+Rb, La)), where a,b,cG ImH. But these elements 
of t(0) commute with those of the form ((0, Rz), (0, Rz), (0, Rz)). This proves 
that the centralizer of g(A,H) in g(A,0) is SO3. 
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Alternatively we can identify this centralizer to the subalgebra of the cen- 
tralizer of t(C) annihilating 62 = j, which is clearly S112. 

The rest of the claim is straightforward. □ 

In particular, we have pairs of reductive subalgebras in g(A, 0 ), each of 
which is the centralizer of the other: this is a reductive dual pair. The classifica- 
tion of reductive dual pairs inside reductive complex Lie algebras was obtained 
in [ 77 ]. We deduce from the proposition above the existence of uniform series 
of what Rubenthaler calls towers of reductive dual pairs: 
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We conclude that sog x t(A), 32 x g(A, R), SU3 x g(A, C) and SO3 x g(A, H) 
are maximal rank reductive subalgebras of g(A, O). A natural question to ask 
is to describe the module structure of g(A, 0 ) over each of these subalgebras. 
For the first one, the answer is given by the triality construction. For the 
second one, we note that g(A,R) = Der(J3(A)) and g2 = DerO, so that 
we are back to the original Tits construction of the exceptional series of Lie 
algebras. We obtain: 

g(A, 0 ) = g2 X g(A,R) © R^© J3 (A)q, 

= su3xg(A,C) © R 3 © J3(A)©(R3© J3(A))*, 

= su2xg(A,H) © R2©Z3(A). 

Here 2^3(A) denotes the space of Zorn matrices, which is a g(A, H)-module, 
see Section 4 . 6 . Note that SU2 acts not on R^ but on C^. Therefore there 
must exist a complex structure on Z3(A) = Z3 (A) © iZg (A), which is not 
g(A, H)-invariant, so that R^©Z3(A) = C^©Z3(A), the sU2-action coming 
from C^. 

These towers of dual pairs in series were discovered in joint work with 
B. Westbury. 

3.9 The Quaternionic Form 

The algebras g(A,B) are also interesting, especially when B = O. Following 
Wolf [ 84 ], each simple complex Lie algebra has a unique real form such that 
the associated compact or non-compact symmetric spaces have an invariant 
quaternionic structure. We will say that this real form is quaternionic. 
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Recall that the rank of a symmetric space G / K, corresponding to some 
Cartan decomposition g = t0p, is the maximal dimension of a subalgebra 
of g contained in p. Such a subalgebra is automatically abelian and is called 
a Cartan subspace. 

Theorem 3.7. The real Lie algebra g(A,0) is quaternionic. A Cartan sub- 
space of t(0) = SO 44 embeds as a Cartan subspace o/g(A,0), which in par- 
ticular has real rank four {independent of A). 



Proof. Recall that each simple complex Lie algebra g, once a Cartan subalge- 
bra and a set of positive roots has been chosen, has a canonical 5-graduation 
defined by the highest root a, more precisely by the eigenspaces of a,d{Ha), 
where Ha denotes the coroot of a. 

If g is the complexification of the compact real Lie algebra g(A, O), we can 
arrange so that the highest root comes from t(0)c = S 08 (C). Note that the 
space of highest root vectors in S 08 (C) is the cone over the Grassmannian of 
isotropic planes in C®. Using this, we then check that we can arrange so that 



iHa — 



/o 

0 

0 

0 

0 

0 

0 



VO 



0 000 000 \ 
0 0 0 0 0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 -1 0 0 

0 0 0 1 0 0 0 

0 0 0 0 0 0 -1 

0000010 / 



The eigenvalues of d„d{Ha) acting on g are 0,±1,±2. The corresponding 
eigenspaces are 



go = t(Ac) X t(Oc)o © Ac,i © © Ac , 2 © ® Ac , 3 © 

g±i = t(Oc)±i © Ac,i © © Ac , 2 © 0^,2 ® Ac , 3 © Oc,3> 

g ±2 = t(Oc)± 2 , 



where we denoted by O* the t-eigenspace for the action of Ha on Oi. Note 
that iHa belongs to DerO = g 2 (see our description of g 2 above), so we can 
let i = 1 and consider the standard action of Ha- Then it is clear that the 
kernel of Ha is the complexification of the standard quaternion subalgebra H, 
and that the sum of the two other eigenspaces is the complexification of eH. 

Now, let 6 denote the involution of g associated to its 5-graduation. By 
definition, 9 acts by (—1)* on g^. Then 9 stabilizes g(A,0), and the corre- 
sponding Cartan decomposition g(A,0) = 6®p into eigenspaces of 9 is given, 
in terms of the Cartan decomposition t(0) = to © Po> by 



t = t(A) X to © Ai © Hi © A2 © H2 © A3 © H 
p po © Ai © eHi © A 2 © eH 2 © A 3 © eH 3 . 



-3, 
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Finally (see [84, 17]), we obtain the quaternionic form g(A,0)n of g by 
twisting this decomposition, that is, letting g(A,0)n = t©*p, which amounts 
to multiplying the brackets in g(A,0) of two elements of p by —1. From the 
description of t and p we have just given, we see that this twist amounts to 
doing two things. First, twist the Cartan decomposition of t(0), which means 
that we replace t(0) = sog by its quaternionic form SO 44 = t(0). Second, 
twist the Cayley-Dickson process of construction of O from H by multiplying 
by — 1 the product of two elements in eH, which amounts to replace O by the 
split Cayley algebra O. This proves the first part of the theorem. The rest of 
the proof is straightforward. □ 



Adjoint Varieties and Quaternionic Symmetric Spaces 

Symmetric spaces with quaternionic structures are closely related to adjoint 
varieties. Recall that on a Riemannian manifold M, a quaternionic structure is 
defined as a parallel field of quaternion algebras Hj, C End (T 2 ,M), x G M, such 
that the unit sphere of Hj, is contained in the orthogonal group SO{TxM). The 
dimension of M is then equal to 4m for some m > 0, and its reduced holonomy 
group is contained in Sp(m)Sp(l) C SO(4m), where Sp(m) denotes the group 
of quaternionic unitary matrices of order m (in particular, Sp(l) ~ is 
the unit sphere in H). Such matrices act on by multiplication 

on the left, which commutes with the scalar multiplication on the right by 
unitary quaternions: the resulting group of orthogonal transformations of 
is Sp(m)Sp(l). 

This group appears in Berger’s classification as one of the few possible re- 
duced holonomy groups of nonsymmetric Riemannian manifolds. The case of 
symmetric manifolds was discussed in detail by J. Wolf in [84], who proved that 
there exists exactly one G-homogeneous symmetric space M with a quater- 
nionic structure for each simple compact Lie group G. When G is simply 
connected, we can write M = G/A.Sp(l). Choosing a complex plane in H 
amounts to choosing a circle C Sp(l), and this induces a fibration 

A = G/K.S^ — >M = G/K.Sp{l) 

whose fibers are two-spheres. Wolf proved that A is a complex variety, ho- 
mogeneous under the complexification G'^ of the real compact group G, and 
endowed with an invariant contact structure. Such varieties were previously 
classified by Boothby, who showed that they are in correspondance with simple 
complex Lie groups of adjoint type. In fact, A is the adjoint variety {G'^Y^, 
the closed orbit in Pg*^. 

In modern terminology, A is the twistor space of M , and Wolf’s work is at 
the origin of this twistor theory, which assigns to each Riemannian manifold 
M with a quaternionic structure a complex variety A which is a S'^-bundle 
over M , defined at each point x G M hy the unit sphere in IrnHa,. 
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The adjoint varieties are endowed with natural contact structures (in- 
duced by the Kostant-Kirillov symplectic structures on the minimal nilpo- 
tent coadjoint orbits, and of which the adjoint varieties are the projectiviza- 
tions). In fact, any compact Riemannian manifold with exceptional holonomy 
Sp(n)Sp(l) and positive scalar curvature has a twistor space that is a contact 
Fano manifold. Our understanding of contact Fano manifolds has recently 
improved very much. First of all, there are not very many: 

Theorem 3.8. (LeBrun-Salamon [69]) Up to biholomorphism, there are only 
finitely many contact Fano manifolds of any given dimension. 

This lead to the following conjecture: 

Conjecture. (LeBrun-Salamon) Let X be a smooth complex projective con- 
tact variety with b 2 {X) = 1. Then X must be the adjoint variety of a simple 
complex Lie group. 

Both the theorem and conjecture can be rephrased purely on the Rieman- 
nian side using the twistor transform. 

In [52], S. Kebekus proved that the space of minimal rational curves 
through a fixed point of X is a Legendre variety (except for the case of P^"“^), 
just as is the case for the adjoint varieties. 



4 Series Of Lie Algebras Via Knot Theory and Geometry 

4.1 Ftom Knot Theory To the Universal Lie Algebra 

One of the main achievements of the last ten years in topology has been the 
definition of the Kontsevich integral, which is a universal invariant of finite 
type for knots. The Kontsevich integral associates to each knot a formal series 
in a space of chord diagrams. The space is a quotient of the space of formal 
combinations of certain types of graphs by the AS and IHX relations. From 
the Kontsevitch integral, it is possible to deduce more standard invariants, 
say numerical or polynomial invariants, if one is given a quadratic Lie algebra, 
i.e., a finite dimensional Lie algebra endowed with an invariant nondegenerate 
quadratic form. An essential point is that the AS and IHX relations can be 
interpreted respectively as the antisymmetry of the Lie bracket and the Jacobi 
identity. 

The main reference for the Kontsevich integral is the beautiful article 
by Bar-Natan [6]. In it he defines and proves (Theorem 4) the mapping from 
quadratic Lie algebras equipped with a representation to a functional on chord 
diagrams (called a weight system) and makes the conjecture (Conjecture 1) 
that all weight systems come from this mapping. This conjecture was dis- 
proved by P. Vogel in [82] which raised the problem of constructing a category 
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more general than that of quadratic Lie algebras that would give rise to all 
weight systems. 

In [83] Vogel defines a candidate for such an object, which he calls the 
universal Lie algebra. The universal Lie algebra is a category T> with the 
following property: for any quadratic Lie (super) algebra g over a field k, there 
is a natural functor from T> to the category Mod^g of g-modules. The objects 
of the category T> are finite sets [n] = {1, . . . , n} , n > 0. Morphisms in T> are 
defined as follows: Homx)([p], [<?]) is the Z- module of formal combinations of 
uni-trivalent abstract graphs with univalent vertices [p] U [g], modulo isotopy, 
and modulo the AS and IHX relations. If g is a quadratic Lie algebra, a functor 
from V to Modfcg is defined at the level of objects by sending [n] to g®". 
To determine the morphisms, consider some uni-trivalent graph defining an 
element of Hom-p([p], [g]). Possibly after isotopy, such a graph can be seen as 
made of elementary pieces of the form 




bracket cobracket symmetry quadratic Casimir 

form 



These pieces should be interpreted as indicated, respectively as the Lie bracket 
g ®2 ^ g^ the cobracket g ^ g®^ (the dual to the bracket), the symmetry 
g ®2 ^ g®^, the quadratic form g®^^g®° = k, and the Casimir element 
g ® 0 ^ g 0 2 quadratic form) . Putting together the contribu- 

tions of all its elementary pieces, one associates a morphism from g®^’ to g®"^ 
to the graph. This morphism depends only on the isotopy class of the graph, 
and factors through the AS and IHX relations, because of the skew-symmetry 
and Jacobi relation for the Lie bracket in g. 

Vogel proves a stronger result for simple quadratic Lie algebras. One can 
then replace the category T> by another one T>' , which is deduced from T> by 
forcing an action of the algebra A of skew-symmetric connected uni-trivalent 
graphs with exactly three univalent vertices. The functor from T>' to Mod^g 
is then compatible with the action of A through a character yg : A — > fc. 

From the point of view of representation theory, the existence and the 
properties of the categories T> and T>' have very interesting consequences. 
Indeed, each “decomposition” of \p] in V will imply the existence of a de- 
composition of g®P of the same type, for every simple quadratic Lie algebra. 
Here, by a “decomposition” of [p], we must understand a decomposition of the 
identity endomorphism of [p] as a sum of idempotents, which will correspond 
to projectors onto submodules of g®^. 

Describing such idempotents is far from easy and requires quite subtle 
computations with uni-trivalent graphs. For p = 2, Vogel obtained the follow- 
ing result. (Vogel’s proof relied on conjecture 3.6 as stated in [83], but Vogel 
himself realized that it is not correct as A, which is conjectured to be integral. 
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has zero divisors. Nevertheless, a case by case verification shows that Vogel’s 
conclusions are indeed correct.) 

Let g be a simple Lie algebra, say over the complex numbers. Then there 
are decompositions 

A^g = Xi 0 X 2 , 

S^Q = Xo®Y2®Y'®Y'', 

into simple g-modules (some of which may be zero), with Xq = C and Xi = 
g. Moreover, there exists a, ( 3 , 7 such that one half the Casimir operator 
acts on Xi, X2,Y2,Y2 and Y2 by multiplication by — a, 2 t — j 3 and 

2t — 7 respectively, where t = a 0 /3 0 7. (In fact the Casimir organizes the 
representations in series, e.g., the representations X^ have Casimir eigenvalue 
kt.) Finally, the dimensions of these g-modules are given by rational functions 
in a, ( 3 , 7 (the dimensions of Y2 and Y2 are deduced from that of Y2 by cyclic 
permutations of a, ( 3 , 7): 



dimg = 

dimV2 = — 
diml2 = ~ 



(g-2t)(/3-2t)(7-2f) 

al3"f 



{a — 2 t) {j 3 — 2 t) (7 — 2t) (a 0 t) {(3 0 t) (7 0 t) 

q,2^2^2 

t{j 3 — 2t)(7 — 2t)(/3 0 t)(7 0 t)(3a — 2 t) 
a^f 3 'j{a — ( 3 ) {a — 7) 



The scalars a, ( 3 , 7 are readily computed for each simple complex Lie alge- 
bra. Note that they are defined only up to permutation and multiplication by 
a same scalar (this is because the Casimir operator has not been normalized) . 
We can therefore consider as a point in P^/63. 



Series 


Lie algebra 


a 


P 


7 


SL 


sin 


-2 


2 


n 


OSP 
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-2 
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02 


-3 
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4 




50 s 


-2 


6 


4 




h 


-2 


5 


6 




ee 


-2 


6 


8 




e? 


-2 


8 


12 




es 


-2 


12 


20 



Note that up in P^, the points of the three series SL, OSP and EXC are 
located on three lines, respectively a + (3 = 0 , 2 a + (3 = Q, 2a 0 2/3 — 7 = 0. 
Hence the slogan that there exists only three complex simple Lie algebras, SL, 
OSP, and EXC. At the level of representations, it is a classical and well-known 
fact that the categories of modules over the sl„, or the so„ and sp2n> have close 
and precise relationships. This is more surprising for the exceptional series. 
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In Section 4.6 we discuss another collection of Lie algebras that form a “line” 
in Vogel’s plane. 

Remark 4-1 ■ In a spirit similar to Vogel’s, Cvitanovic [21] has proposed a proof 
of the Killing-Cartan classification. Using notation inspired by the Feynman 
diagrams of quantum field theory, he represents the invariant tensors of a Lie 
algebra by diagrams, and by requring that irreducible representations be of 
integer dimension, he deduces severe limits on what simple groups could pos- 
sibly exist. His approach dates back to 1976 [19, 20]. The method provides 
the correct Killing-Cartan list of all possible simple Lie algebras, but fails to 
prove existence. 

4.2 Vogel’s Decompositions and Tits Correspondences 

As remarked above. Tits correspondences aid one in decomposing the tensor 
powers of nice (e.g., fundamental) representations into irreducible factors. We 
illustrate this by showing how to recover Vogel’s decompositions of 5'^g and 
A^q. In fact we can recover Vogel’s higher decompositions as well, but we need 
to use a slightly more general technique which we call diagram induction, see 
[63] . Using diagram induction, we are also able to recover the Casimir functions 
for the representations occuring in series such as the X^. 

If U is a fundamental representation corresponding to a root that is not 
short (e.g., the fundamental adjoint representations) and X = GjPa C PU 
the closed orbit, then the Fano variety Fi(X) of P^’s on X is G-homogeneous 
by Theorem 2.5, and according to Tits fibrations, Fi(A) = GjPs where S 
is the set of roots joined to a in D{q). Let V 2 = (Fi(X)) denote the linear 
span of the cone over Fi(A) in its minimal homogeneous embedding. Note 
that Fi(A) C G(2, V) C A^V, and we conclude that V 2 C A^V . (To do this, 
one needs to make sure the embedding of Fi(A) is indeed the minimal one, 
which is one reason we need the stronger technique of diagram induction.) 

In the case of the adjoint representation, we also know, because of the 
cobracket, that g C A^g. In fact, we have T^g = g0g2. (In the case of a„, 
(a „)2 is the direct sum of two dual irreducible representations, which is also 
predicted by Tits fibrations.) 

Similiarly, inside 5'^g, we know there is a trivial representation Xq cor- 
responding to the Killing form, and the Cartan power g*-^\ which, breaking 
Vogel’s symmetry, we set Y 2 = g*-^^ so the problem becomes to recover the 
remaining modules, which we think of as the “primitive” ones. These are pro- 
vided in most cases by Tits fibrations of homogeneous quadrics contained in 
X. There are up to two such families, we call the larger one gg = and if 
there is a second we call it gg/ = Y^' , see [63]. Thus, using Tit’s correspon- 
dences to find the primitive factors, one recovers the Vogel decomposition of 
g ®2 g simple (except for c„, which is tractible using diagram induction). 
Even when our methods predict all factors, we would like to emphasize that 
they do not explain why these are the only factors. 
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While our observations enable one to recover uniform decompositions of 
plethysms in series, the questions of why such series exist and how to find 
them systematically without looking at the list of simple Lie algebras is mys- 
terious using our present techniques. It would be wonderful and challenging 
to generalize our perspective sufficiently to approach Vogel’s. One indication 
that such a generalization might be possible is that, with the above choices, 
we obtain a geometric interpretation of Vogel’s parameter ( 3 , namely f 3 is the 
dimension of the largest quadric hypersurface contained in Vad (see [ 63 ]). If 
there is a second unextendable quadric in Vad, then 7 is its dimension. 

4.3 The Exceptional Series 

Inspired by Vogel’s work, Deligne [ 24 ], investigated the decompositions of the 
tensor powers of the exceptional Lie algebras into irreducible components, 
going up to degree four (with the help of Cohen, deMan and the computer 
program LiE, [ 14 ]) and giving more explicit dimension formulas. 



4.3.1 Decomposition Formulas 

As with the Vogel decompositions, these decomposition formulas are all uni- 
form, in the sense, for example, that the numbers of irreducible components 
are always the same when the algebra varies in the exceptional series. This 
assertion has to be understood with some care: it happens that some compo- 
nents vanish, or should be taken with a minus sign. In addition, Deligne and 
Vogel deal with the algebra twisted by the symmetry of the marked (for the 
adjoint representation) diagram. 

In degree two, one has the decomposition of Vogel, but the decomposition 
of simplifies because the equation 2 a -|- 2/3 — 7 = 0 implies Y2 is zero. In 
degree three we have 

S' 3 g = gQAaQAQVaQVg', 

A^g = C 0 A2 © V2 © © A3, 

S'2ig = 2 g © A2 © I2 © V2' © A © C © C" 

where the (normalized) Casimir operator acts on A2, A3, A, Y2, Y2, ©3, Yf, C, C 
by multiplication by 2 , 3 , 8 / 3 , ( 2/3 + 67)737, ( 2 a + 67)737, 2(/3 + 7)/7, 
2 (a + 7)/7, ( 2/3 + 67)727, ( 2 a + 67)727 respectively. Again, we are able to 
account for nearly all the factors and Casimir functions appearing using dia- 
gram induction. 



4.3.2 Dimension Formulas 

For each exceptional Lie algebra SI2, sfs, sog g2, f4, ^6) ^7) ^8, let A = 
— 3 , — 2 , — 1 , — 3 / 2 , — 2 / 3 , — 1 / 2 , — 1 / 3 , — 1/6 respectively. A is a linear function 
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of the length of the longest root (with the Casimir normalized to act as the 
identity on g). In Vogel’s parametrization this gives (a,/?, 7 ) = (A, 1 — A, 2). 

From the decomposition formulas stated above and the knowledge of the 
Casimir eigenvalue on each irreducible component, it is easy (at least with 
a computer) to calculate the dimensions of these components as rational func- 
tions of A, if one knows the dimension of g itself in terms of A. For example, 



dimg = —2 
dimV2 = 5 



(A + 5)(A-6) 
A(A-l) ’ 

(A + 3)(A + 5)(A-4)(A-6) 



dimy2 = — 90 
dimYs = — 10 



A2(A- 1)2 
(A + 5)(A-4) 



A2(A-1)(2A-1)’ 

(A -h 5)(5A - 6)(A - 4)(A - 5)(A - 6 ) 
A3(A- 1)2(2A- 1)(3A- 1) 



A miracle, Deligne says, is that the numerators and denominators of these 
rational functions all factor out into products of linear forms with simple 
integers coefficients! Note that this miracle does not occur for the Vogel di- 
mension formulas starting with degree three. 

In addition, there is a striking duality property: the involution A i-^- 1 — A 
takes the dimension formula for Y 2 ,Y^ into those for Y 2 , V3, while it leaves 
unchanged the dimension formulas for g, X 2 , A 3 , A. 

One can attempt to continue the decompositions in degree five, but there 
for the first time there appear different representations with the same Casimir 
eigenvalue and Deligne’s method cannot be used to compute dimensions. This 
suggests that if one wants to continue the formulas, it might be better to 
restrict to decompositions into Casimir eigenspaces rather than irreducible 
modules. 

In the last part of [24], Deligne conjectured the existence of a category, 
supposed (just as the universal Lie algebra defined by Vogel, but with much 
stronger properties) to map to the categories of modules over each exceptional 
Lie algebra. The properties of this hypothetic category would then explain at 
least some of the phenomena discovered by Vogel and Deligne for the excep- 
tional series. At the moment, it seems no progress has been made on this 
conjecture. 



4.3.3 Deligne Dimension Formulas Via Triality 

Deligne’s conjecture is elegant while his proof is brute force computer based. In 
[62] we reprove and extend his formulas using methods whose level of elegance 
is somewhere between the conjecture and proof of Deligne. The starting point 
was our observation that the parameter A could be written as A = — 2/(a-|-2), 
with a = — 2/3, 1, 2, 4, 8 . (This implies that (a,/?, 7 ) = (—2, a -I- 4, 2a -I- 4).) 
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This indicated that the relation between exceptional Lie algebras and normed 
division algebras should be exploited. The idea was to use this relation to find 
a good description of the exceptional root systems, and then apply the Weyl 
dimension formula. 

The Tits construction is not convenient to describe the exceptional root 
systems and we were led to rediscover the triality model. Recall that for the 
exceptional series, 

g(A, O) = t(A) X t(0) 0 (Ai 0 Oi) © (Aa 0 O 2 ) © (A 3 0 O 3 ), 

can be identified with the compact form of ( 4 , eg, C 7 , eg respectively for A = 
K,C,EI, O. In what follows we complexify this construction, without changing 
notation. In particular 1(0) is now the complex orthogonal Lie algebra sos(C). 
The point is that 1 (A) x 1(0) is now a maximal rank reductive subalgebra 
of g(A,0). In particular, if we choose Cartan subalgebras ()(A) C 1(A) and 
t)(0) C 1(0), we obtain a Cartan subalgebra f)(A) x t)(0) C g(A,0). This 
provides a nice description of the root system of g(A,0). There are three 
kinds of roots: 

• the heart of the root system is the set of roots of 1(0) = sos(C), 

• the linear part is made of the roots of the form p, + n, where /i is a weight 
of Oi and ly a weight of Ai for some i, 

• the residue is the set of roots of 1 (A). 

When A = 0, the root system is of type D^. When A = K, the root system is 
of type © 4 . There is no residue in this case. The heart is the set of long roots, 
and the linear part the set of short roots. Both are root systems of type 1 ) 4 . 
When we change A into C,H, O, the linear part expands, is size being each 
time multiplied by two, and its roots become long. The residue also increases, 
but in limited proportions. 

Next we specify the positive roots inside the exceptional root systems. 
They are the roots on which some linear form takes positive values, and we 
choose a linear form that takes very large values on the set Z\+ of positive 
roots of sos(C). Then the positive roots in the linear part of the root system 
are the fx+n for p, belonging to an explicit set S of weights. This implies that 
the half-sum of the positive roots can be expressed as p = + Pt{0) + Q7t(0) > 

where pt(A) G f)(-^)* denotes the half sum of the positive roots in 1 (A) and 
7 i(0) G f)( 0 )* is the sum of the weights belonging to U. 

We are now close to being able to apply the Weyl dimension formula to 
g(A, 0)-modules. What remains to do is to describe the dominant integral 
weights in t)(A)* x ()(0)*. At least we can describe the set C(0) C ()(0)* 
of weights that are dominant and integral for each g(A,0). Of course, such 
weights are be dominant and integral in sog(C), but this is not sufficient. 

Proposition 4.2. The setC(O) C ()(0)* is the simplicial cone of nonnegative 
integer linear combinations of the four following weights: 
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w(g)= 1-2 



\i 



iv(X2) =2-3 



^ 2 ’ 



coiXs) = 3 - 4 , iv{Y') = 2 - 2 ^ 



1 



'3 H 

The lattice in t(0)* generated by C(0) is not the weight lattice, but the root 
lattice 0/ 508(C). 



These weights, that we expressed above in terms of simple roots, occur 
respectively, w(g) = CO2 as the highest weight of g, oj{X 2 ) = + W3 + W4 as 

the highest weight of yl^g, uj{X‘i) = 2toi + 2oj^ as the highest weight of yl^g, 
and io{Y 2 ) = 2wi as the highest weight of S'^g — g^^^. 

We can now apply the Weyl dimension formula to weights in (7(0), con- 
sidered for each choice of A as integral dominant weights of g(A,0). It is 
essential that the residue of the root system will not contribute. We obtain 
(see [62] for details): 



Theorem 4.3. The dimension of the irreducible 2{A,0)-module of highest 
weight to G (7(0) is given by the following formula: 



dim V7 



n 



(a7i(0) + Pt(0) + C«^) 

(«7t(0) + dt(0);C«'^) 



f (o7i(0) + Pi(0) + f^'^) + t ~ A 

X TT V (w,/3'^) ) 

( (o7i(0) + Pi(0) + 0 ^) — § 

I 

If w = pw(g) -I- qto{X 2 ) + ru}{Xs) + suj{Yf), this formula gives a rational 
function of a, whose numerator and denominator are products of 6p-|- \2q + 
16r -I- 10s -I- 24 linear forms in a with integer coefficients. Since A = — 2/(a-|-2), 
we obtain formulas of the type of those of Deligne, and an infinite family 
of such. For example, the fc-th Cartan power g(A,0)^^^ is Yk in Deligne’s 
notations, and we get 

(2fe-l)A-6 ^ ((j - 1)A - 4)((j - 2)A - 5)((j - 2)A - 6) 

" fc!A'=(A + 6) (jA-l)((j-l)A-2) 

Also we can understand why we can expect good dimension formulas for all 
irreducible components of g(A, O) ® ^ only for small k. This is because when k 
increases, we will unavoidably get components whose highest weight does not 
come only from sos(C), but has a contribution from (|(A)*. Then the Weyl 
dimension formula does not give a well behaved expression. 

While this takes some of the mystery out of the dimension formulas, the 
remarkable symmetry A 1 — A noticed by Deligne, which in our parameter 
a is a — 4(a -I- 3)/(a -I- 4) remains beyond our understanding. 
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4.3.4 Numerology 

In the formula above for dim Y^, there are very few values of A for which dimY^ 
is an integer for all k. We are currently, with B. West bury [65] investigating 
these extra numbers that produce integers and Lie algebras that go with 
them. At least in the case a = 6, one is led to an algebra of dimension six, the 
sextonions, that leads to a nonreductive row of the magic square between the 
third and fourth. Like the odd symplectic groups of Proctor [73] and Gelfand 
and Zelevinsky [36], this series has certain behavior as if it were a series of 
reductive Lie algebras. 

4.4 Preudenthal Geometries 

The discovery of the Cayley plane OP^ and its automorphism group by Cheval- 
ley, Schafer and others led to a period of intense activity around the ex- 
ceptional groups and their geometric interpretations in the 1950’s involving 
Preudenthal, Tits and Rozenfeld. 

Preudenthal and Rozenfeld defined explicit varieties whose automorphism 
groups (or groups related to the automorphism groups) were the exceptional 
groups. The starting point is the Jordan algebras J3(A). The projective 
plane AP^ is the space of rank one idempotents of J73(A). The subgroup of 
preserving the determinant of order three matrices (which is well 
defined even for A = O) then acts transitively on AP^. In particular, one 
recovers the transitive action of Eq on OP^. The subgroup of GL (773(A)) 
preserving the determinant and the quadratic form (A, B) = trace(AR) is 
the automorphism group of the Jordan algebra 773(A). It acts irreducibly on 
773 (A)o, the subspace of trace zero matrices. Tits and Preudenthal defined el- 
liptic and projective geometries on AP^ with these groups of isometries. In the 
elliptic geometry, a point is the same as a line, and is defined by an element 
of APg. In the projective geometry, a point is defined to be an element of AP^ 
and a line is determined by an element [a] of the dual projective plane (the 
rank one idempotents in the dual Jordan algebra corresponding to the dual 
vector space), namely {X G AP^ | a{X) = 0}. 

A synthetic geometry Preudenthal terms symplectic may be associated to 
each of the groups in the third row. A point is an element [X] G Pg(A,H), 
such that ad(X)^ = 0. This condition is equivalent to requiring that \X] is in 
the adjoint variety Xad C Pg(A,H). A plane is is determined by an element 
[P] G PZ3(A), P X P = 0. (See Section 4.6 for the definition of the cross 
product.) This condition is equivalent to saying that [P] € Gu,(A^,A®) C 
PZg(A), the closed orbit. The corresponding plane is {[X] G Xad | XP = 0}. 
A line is an intersection of two planes with at least two points. It is also 
determined by a point [a] G Fi(X) C PV2, where V 2 is the representation 
defined in Section 4.6 below and Fi(Gu,(A^, A®)) is the closed orbit (which, as 
the notation suggests, parametrizes the lines on the closed orbit Gu,(A^, A®) C 




Representation Theory and Projective Geometry 115 



PZ 3 (A)). One can then define incidence rules for these geometric elements 
which generalize the symplectic geometry in P®. 

For the fourth line of Freudenthal’s magic square Freudenthal defines 
a metasymplectic geometry. There are now four types of elements, points, lines, 
planes and symplecta, with incidence rules explained in detail by Freudenthal. 
As above, each geometric element is a point in the closed orbit of the projec- 
tivization of a g(A, 0)-module. Here is the table of types of elements: 

Geometric element Variety Dimension 

Point Apoint C PflQ 9a + 6 

Line Aii„e C Pfla 11a + 9 

Plane Apiane C Pfl2 9a + 11 

Symplecta Agympiecta C Pfl(A, O) 6a + 9 

We see the four generators of the cone (7(0) in Proposition 4.2 define 
the four types of elements of Freudenthal’s metasymplectic geometry! The 
analogous results hold for the second and third rows of the magic chart, that 
is, Freudenthals elements are the closed orbits in the projectivizations of the 
modules whose highest weights define the fixed cones for our dimension for- 
mulas in [62]. 

4.5 A Geometric Magic Square 

Consider the following square of complex homogeneous varieties, which we 
investigate in [61]: 



M 


C 


H 


o 




K V2{Q^) 


P(TP2) 


G^(2,6) 


OP^ 0 


section of Severi 


C 


p2 ^ p2 


G(2,6) 


OP^ 


Severi 


H G^(3,6) 


G(3,6) 


§12 


Er/Pr 


Legendre 


O Ff 


^ad 


^ad 


^ad 


adjoint 



This geometric magic square is obtained as follows. One begins with the 
adjoint varieties for the exceptional groups: this is the fourth line of the square. 
Taking the varieties of lines through a point and applying Theorem 2.5, one 
obtains the third line. The second line is deduced from the third by the same 
process. Then take hyperplane sections to get the first line. We obtain pro- 
jective varieties that are homogeneous under groups given by Freudenthal’s 
magic square. 

4.6 The Subexceptional Series 

In this final section we consider the series corresponding to the third row of 
the extended Freudenthal chart: 
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SI2, SI2 X SI2 X sb, Spg, sIq, SO12, ey 
and view the series from our various perspectives. 

4.6.1 Relation To the Universal Lie Algebra 

This series also corresponds to a new line in Vogel’s plane, namely (a, /?, 7) = 
(—2, a, a+4), where a = —2/3, 0, 1, 2, 4, 8. Moreover, Vogel’s formulas are valid 
for the semi-simple Lie algebra sl2 x SI2 x SI2 despite the plane being defined 
only for absolutely simple objects. Unlike the three lines discovered by Vogel, 
this line is generic to order three among actual Lie algebras, in the sense that 
no Vogel space is zero except Ag , which is zero for all actual Lie algebras. We 
have dimg(a) = 3(2a -I- 3) (3a + A)/{a + 4). 

4.6.2 Freudenthalia 

For this series there are three preferred representations from Freudenthal’s 
perspective, corresponding to the ambient spaces for points, lines, and planes 
in his incidence geometries. The points representation is just g = g(A, H) and 
has a nice model thanks to the triality construction. For a discussion of the 
line space, which we will denote V2 = V2(a), see [61]. We have dimV2(a) = 
9(a-|- l)(2a-|- 3). The most preferred representation is for the planes, which we 
denote V = V(a) and has dimU (a) = 6a-|-8. This space is the complexification 
of the algebra of Zorn matrices we encountered in Section 3.8: 

Z3(A) = {(^“ |a,6eM, A,Vg J3(A)}. 

It can be endowed with an algebra structure with multiplication 

f a\ ( 0,2 A2\ f ai02 -l- trace [X1Y2) aiX2 &2A1 -|- Fi x 

yVi bi J \^F2 ^2 / \fl2F1 -|- &1F2 + Ai X X2 b\b2 + trace {X2Y1) J 

Here the product A x F is defined by the identity tr((A xY)Z) = det(A, F, Z), 
where det is the polarization of the determinant. The algebra is in fact 
a structurable algebra (see Section 2.5), with V{a) = Zs{A) = (F^,) C 
FrAadjoint(A, O) where Aadjoint(A, O) are the exceptional adjoint varieties. 
In fact, Zorn matrices give all simple structurable algebras of skew-symmetric 
rank equal to one, and one can show directly that the derivation algebra of 
Zg(A) is 0(A,H). 

Using this construction one can consider the automorphism group of 2g(A) 
in addition to its derivation algebra, and this can be done on any field (of 
characteristic not equal to 2 or 3). Using this. Garibaldi constructs forms of 
Ay over an arbitrary field [33]. 

The closed orbit Apianes C PZ3(A) is a natural compactification of the Jor- 
dan algebra J73(A), and its embedding inside PZ3(A) is given by the translates 
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of the determinant on f73(A). This is the conformal compactification consid- 
ered by Faraut and Gindikin in [30]. In [61] we propose a geometric interpre- 
tation of Xpianes as the Grassmannian of O^’s in O® isotropic for a Hermitian 
symplectic form and use the notation Gu,(0®,0®). 



4.6.3 Decomposition Formulas 

The plethysms of V are extraodinarily well behaved in series. For example, 
here is a decomposition of S^V into irreducible components for each k. 

0 = (1 - tV)-\l - - t‘‘)-^(l - 

k>0 

The right hand side in the formula is to be expanded out in geometric series 
and multiplication of representations is taken in terms of Gartan products 
V\Vf^ = The case of sl2 x SI2 x 5(2 is somewhat special, since the formula 

above holds true only if the natural action of ©3 is taken into account. See [63] . 

Each of the factors in the rational function above can be accounted for 
in terms of diagram induction. In particular, g = Vq, the ambient space 
for the variety parametrizing the G-homogeneous quadrics on Xpianes and 
V2 = (IFi (-^planes)) IS the ambient space for the variety parametrizing the 
lines on A^pianes- 



4.6.4 Dimension Formulas 



Our method for applying the Weyl dimension formula in series also works for 
the three distinguished representations. For example, we have 



dim 



2(z “h ‘ 2 k 2 

(X \ 



( 



fc+2a+l\ fk+^- + l\ 

20-1-1 A M + i ) 

A+f+ij 

I §+i ) 



where the binomial coefficients are defined by = (1 + x) ■ ■ ■ (^ + x) / k! 

and thus are rational polynomials of degre k in x. 

Note that since is the complement of /fc(Xpianes) in S^V* , the above 
formula also gives the Hilbert functions of the varieties Xpianes in a uniform 
manner. 



4.6.5 Zakology 

The varieties Xpianes C PA are important for the following geometric classifi- 
cation problem: Given a smooth variety X C PA, one defines its dual variety 
X* C PA* to be the set of hyperplanes tangent to X. Usually the degree of 
X* is quite large with respect to X and Zak has proposed the problem of 
classifying smooth varieties whose duals are of low degree [86] . 
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Here the duals of Xpianes C TV are of degree four. Moreover, they are the 
tangential varieties of the closed orbits in the dual projective space, i.e., we 
have -^planes — '^(^planes)- 

The first variety in the series is Xpianes(— 2/3) = V 3 (P^) and the equation 
of its dual is the classical discriminant of a cubic polynomial. Using A-valued 
variables, we write the equations for the duals in a uniform fashion, see [61]. 
In particular, we characterize the other quartics by their restriction to the 
preferred subspace. The second variety in the series is X = Seg(P^ x P^ x P^) 
and its dual is Cayley’s hyperdeterminant, see [35] . Our restriction result gives 
a new characterization of the hyper determinant. 



4.6.6 Orbits 

The orbit structure is also uniform. 

Proposition 4.4. [61] For each of the varieties Xpianes = Gu,(A^, A®) C PU 
there are exactly four orbits, the closures of which are ordered by inclusion: 

c a+(Ga,(A3, A®)) c t{G,,{A^,A^)) c PU. 

The dimensions are respectively 3a + 3, 5a + 3 and 6a + 6. 

Needless to say, the singular orbit closures have uniform desingularizations 
by Kempf’s method. 

Once again, the triality model plays a unifying role for geometric and rep- 
resentation geometric phenomena which at first glance seem sporadic. Another 
striking example of this role, which is currently under investigation, concerns 
nilpotent orbits in exceptional Lie algebras and the associated unipotent char- 
acters of exceptional Chevalley groups [66] . 
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Geometric Realization Of T-shaped Root 
Systems and Counterexamples 
To Hilbert’s Fourteenth Problem 
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Abstract. Generalizing a result of Dolgachev, we realize the root system Tp.q.r in 
the cohomology group of a certain rational variety of Picard number p -\- q -\- r — 1. 
As an application we show that the invariant ring of a tensor product of the actions 
of Nagata type is infinitely generated if the Weyl group of the corresponding root 
system Tp.q.r is indefinite. In this sense this article is a continuation of [4]. 



1 The Dynkin Diagram Tp^q^r 




defines a lattice ip,q,r of rank p+q+r — 2. The set of vertices Oi’s is its basis 
as a free Z-module. The bilinear form is defined to be (ai.aj) = —2,0 or 1 
according as i = j, at and aj are disjoint or joined by an edge. It is known 
that the root system Tp^q^r is of finite type, affine or indefinite according as 
l/p+ 1/(1+ 1/r is > 1,= 1 or < 1 ([2], Ex. 4.2). 

In the case p = 2, Dolgachev, [1], realizes this root system T 2 ^q^r in the 
cohomology group of the blow-up Bl^+rpts of the (r — l)-dimensional 
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projective space at q + r points in general position. This is a genera- 

lization of the classical discovery that the configuration of the 27 lines on a 
nonsingular cubic surface S C P^, which is the blow-up of at six points, 
has a symmetry of the Weyl group of Eq = T2,3_3 (cf. [3]). The moduli of cubic 
surfaces is a quotient of an open set of P^ x P^ by W{Eq) (cf. [1]) and the 
cohomology group Z) has a monodromy action of W(Ee). 



e.i — 62 C'i — c,3 e-i — 64 6-4 — 65 65 — 6(i 

O O O O O 



6 h -61-62-63 



The reflections by Ci — Cj+i, 1 < i < 5, generate all permutations of the 
6 points which are the centers of blowing up and that by — ei — 62 — 63 
corresponds to the quadratic Cremona transformation 

p2 > p2^ ^ {l/xi : 1/X2 : I/X3). 

It is natural to extend the result of Dolgachev to all diagrams of T-shape. 
The answer is simple: just generalize P’’“^ to the product (P’'“1 )p~i of its 
p — 1 copies. Let X be a blow-up of the product (P’'~1)P“1 q + r points 
in general position. The second cohomology group E[^{X,7i), or equivalently 
PicX, is a free Z-module of rank p + q + r — 1 and has a basis consisting of 

hi, 1, and ej, ^<j<q + r, (1) 

where hi is the pull-back of the hyperplane class on the tth factor of 

and 6j the class of the exceptional divisor over the jth center of blowing up. 

We refer (1) as the tautological basis. 

Theorem 1. The root system Tp^q^r is realized in the orthogonal complement 
L of the anti- canonical class ci(X) in the second cohomology group Z) 

endowed with a certain symmetric bilinear form. {See Section 3.) Moreover, 
for each element w : H'^{X,Z) — > E['^{X,Z) of the Weyl group IT(Tp,q,r), 
there is a strong birational map Eu, : X.^ ^ X of a a blow-up X.^ of 

(pr-i)p-i [if q^j. points such that the pull-back of a tautological basis of X.^] 
coincides with the transformation of that of X by w. 

A birational map is called strong if it is an isomorphism in codimension 
one. 

In the special case q = 1, X has a birational action of W{Tpp^r) = 
W{Apj^r-i), which is the symmetric group of degree p -\- r. In fact A is a 
GIT quotient of the Grassmannian variety G{p,p -\- r) by the maximal torus 
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T ~ Qf j|;g automorphism group G ~ PGL(p+ r). Hence the Weyl 

group of G acts on X birationally. X is a compactification of the configuration 
space of ordered p + r points on 

Remark. The isomorphism between G{p,p + r) and G{r,p + r) induces a 
strong birational map between Bb+ipts and Blp+i pts 

and hence that between Bl^+^-pts (pr i^p 1 and Blp+, pts (P^ For ex- 

ample Blq+j.pts P*"”^ is strongly birationally equivalent to Bl 2 +qpts (P^)’'“^. 



2 Generalized Nagata Action 



Our interest in Theorem 1 comes from Nagata’s counterexample to Hilbert’s 
fourteenth problem also. Let 



€ C J, C[xi,..., Xn ; 5 ■ • ■ 7 ^n] ■ *5’, 

\ Xi^ Xi 1 / ■ / 

S , J. , 1 < * < n, 

\yi^yi + tiXi 



be the standard unipotent action of C”, or the additive algebraic group G" 
more precisely, on the polynomial ring S of 2n variables and G C C" a general 
linear subspace. In [5], Nagata studied the invariant ring of the subaction 
of G. The key fact is that the ring is isomorphic to the total coordinate 
ring 

TC{X):= 0 H°{X,Ox{ah-he, &„e„)) 

:= © H«(X,L) 

LePicX 

of the variety X = BlnpisP*^”^, where r is the codimension of G C C". 

In [4], we pay attention to the support of this graded ring TC{X), which 
is the semi-group F,S X C PicX of effective divisor classes on Jf. A divisor 
D C X is called a (— l)-divisor if there is a strong birational map X ■ ■ ■ ^ X' 
such that the image of D can be contracted to a smooth point. Obviously 
the linear equivalence class of a (— l)-divisor is indispensable as generator of 
Eff A. 

Assume that the inequality 



1 

2 



1 



n — r 




(4) 



holds. Then the Weyl group IF(T 2 ,n-r,r) of X is infinite and infinitely many 
(— l)-divisors on X are obtained as its orbit. Hence Eff X and TC{X) are not 
finitely generated. This is an outline of the main argument of [4]. 

In order to obtain more examples, we take p — 1 actions 



Gi i C[xi, ... ,Xn,yi, ■■■ ,yn] =■ S, Gi c C”, 
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of Nagata type on the same polynomial ring S and take their tensor product 

p-i 

G — Gi i S ®c[a;] • • • ®c[x] S =: S (5) 

i=l 

over C[xi, . . . , x„]. S' is a polynomial ring of pn variables. 

Theorem 2. The invariant ring S'^ of the above action (5) is isomorphic to 
the total coordinate ring 

Gd (^7 “t“ ' * * “t“ ap—\hp—\ ^iCi * * * bjiCji)^ 

of the blow-up X of the product x • • • x ofp— 1 projective spaces 

at n points, where hi is the pull-back of the hyperplane class o/P’’*“^. 

We can localize the action (5) by xi,...,Xn since they are G-invariant. 
Then the additive group G acts on 

S[Xi , . . . , X^ ] S[x^ 7 • ■ ■ j X^ ] 0C[a:,a:“i] ' ' ' *^[^1 5 ■ ■ ■ ? ] 

C[Xi , • . . , Xyj , y\f X\ . • . , yn! ^n\ 

• • • ®C[x,x-i] C[xf \ . . . , yi/xi . . . , yn/Xn]. 

Since (fi, . . . ,t„) G Gi acts by the translation pj / Xj pj / Xj -\-tj, 1 < j < n, 

the invariant ring S[xJ"^, . . . is a polynomial ring of ri + • • • + rp_i 

variables. The rest of the proof is similar to that of the case p = 2 in [4] and 
we omit it. 

If rfs are all the same, then we can apply Theorem 1 and obtain the 
following by the same reason, that is, X has infinitely many (— l)-divisors. 

Theorem 3. The invariant ring o/(5) is not finitely generated if Gi GI C" 
are general subspaces of codimension r and if the inequality 



p n — r r 

holds. 

In the case p = 2 there are three cases where the diagram is of affine type: 



r 


q 


A 


diagram 


dim G = q 


3 


6 


BlgptsP" 


^2, [6], 3 


6 


4 


4 


BlgptsP" 


^2, [4], 4 


4 


6 


3 


BlgptsP® 


^2, [3], 6 


3 



Allowing p > 3, we obtain three new ones with p < r. (See Remark at the end 
of Section 1.) 
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p 


r 


q 


X 


diagram 


dimG = {p— l)q 


3 


3 


3 


Bl6pt.p2 XP2 


^3, [3], 3 


6 


3 


6 


2 


Blspt^P® xP5 


^3, [2], 6 


4 


4 


4 


2 


Bl6pt«p3 X p3 X p3 


TiJ2],4 


6 



Tp^[q]^r is the diagram Tp^q^r plus an extra vertex, which is defined in the next 
section. 



3 Proof Of Theorem 1 



Let X be as in the theorem. The anti-canonical class ci(X) is equal to 



r{hi -b • • • -b hp-i) — (r — 2)(ei -b • • • -b Cq+r)- 



We define an integral symmetric bilinear form on Z) as follows: 

1 . hi and ej are orthogonal for every 1 < i < p — 1 and 1 < J < <? -b r, 



2 . 



(ei-Cj) — 



-1 * = j, 



and (hi.hj) 



0 otherwise 
We take a new Z-basis of {X, Z) consisting of 



r - 2 i = j, 
r — 1 otherwise. 



1. hi — Cl — * * * — Brj 

2. hi — hi+i, 1 < i < p — 2, 

3. 6j — Bj-f-i, + 1, and 

4. 6q-i-r- 

Then H‘^{X,Z) becomes a root system with the diagram on the next page 
which is denoted by (See [2], Section 5.11 also for T 2 jq]_ 3 .) 

The p + q + r — 2 classes except for e„ are of length —2 and form a basis 
of the orthogonal complement L of c\{X) in H^{X, Z). Hence L is isomorphic 
to the root lattice Lp^q^r- 

In order to show the latter half of Theorem 1, it is enough to check it for 
the simple reflections. This is obvious for ej — e^+i’s and hi — ft-i+i’s since they 
correspond to transpositions of a pair of centers and a pair of factors. The 
refiection with respect to hi — Ci — ■■■ — Cr transforms the tautological basis 
(1) of H‘^{X, Z) as follows: 



hi^ {r- l)hi - (r - 2) e^, 

hii-^ {r - l)hi + hi - {r - 1) e^, 2 < t < p - 1, 

Cj hi — 6i — ■■■ — 6j — ■■■ — 6r, 1 < J < 

! r -b 1 < j < g -b r. 



( 6 ) 



Let P = {pi, . . . ,pr} be a set of r distinct points on (P^ 



IS non- 



degenerate if zth components p\ 



b) 



(2) T^T 

Pr spans P 



^ for every 1 < i < p—1. If 
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Cl 62 62 63 Cj- C^-|-l Cg-fr—l Cg-fT’ 




P is non-degenerate we can choose homogeneous coordinates of P’’ ^’s such 
that P is the image of the r coordinate points by the diagonal morphism 
A : P’'-! ^ (P’'-i)P-b 

Lemma. Let P = {pi, . . . ,pr} and Q = {qi, . . . ,qr} be non- degenerate sets 
of r points of and Xp and Xq he the blow-ups with center P and 

Q, respectively. Then there exists a strong hirational map 

— 'd'p.Q ■ Xp ■ ■ ■ — > Xq 

such that 

r T*h[ = (r - l)hi - (r - 2) e,, 

< = {r- l)hi -\-hi- (r-l) 2<i<p-l, (7) 

[ T*e'j = hi- ei Cj e^, l< j <r, 

where {hi,Cj} and } are tautological bases ofPicXp and Pic Xq, res- 

pectively. 

Proof. We may assume that both P and Q are the image of the coordinate 
points by the diagonal morphism A. Consider the (toric) Cremona transfor- 
mation 

T : P’'-^ X P’'-^ X • • • X P’-i > P’'-^ X P’'-^ X • • • X P^-\ 

((xi : X2- ...: Xr), (j/i : 2/2 : • • • : Vr), . . . , (zi : Z 2 : ■ . . : Zr)) ^ 

(i : il : . . . : £i)). 

Xi X2 Xr Xi X2 Xr X\ X 2 Xr 
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Its indeterminacy locus is the union Ui<i<:j<rHinHj of the intersection of all 
pairs of Hi’s, where Hi, , Hr are the pull-backs of coordinate hyperplanes 
of the first factor. The map ^ is an isomorphism off the union Ui<i<rHi and 
is the identity. By blowing-up, we obtain the commutative diagram: 



Xp 



i 

pr— 1 



i 



Let {X 2 , . . . ,Xr),{Y 2 , . . . ,Yr), . . . ,{Z 2 , . ■ . , Zr) be the standard inhomoge- 
neous coordinate of arround pi = A{1 : 0 : ... : 0). Then the 

rational map Xp ■ ■ ■ ^ (pr-i^p-i jg given by 



El ^ {X2 : . . . : Xr :Y 2 : . . . :Yr : . . . : Z2 : . . . : Zr) ^ 





. . : — 






1 

1 




vV X 2 


Xr) 


V X 2 


Xr) 


V X 2 


Xr) ) 



over the exceptional divisor Ei over pi. Hence E resrtricted to Ei is a bira- 
tional map onto (the strict transform of) the divisor Hi. Therefore, E is an 
isomorphism in codimension one. (7) is obvious. □ 
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Abstract. We discover a class of projective self-dual algebraic varieties. Namely, we 
consider actions of isotropy groups of complex symmetric spaces on the projectivized 
nilpotent varieties of isotropy modules. For them, we classify all orbit closures X 
such that X = X where X is the projective dual of X. We give algebraic criteria of 
projective self-duality for the considered orbit closures. 



1 Introduction 

Under different guises dual varieties of projective algebraic varieties have been 
considered in various branches of mathematics for over a hundred years. In 
fact, the dual variety is the generalization to algebraic geometry of the Legen- 
dre transform in classical mechanics, and the Biduality Theorem essentially 
rephrases the duality between the Lagrange and Hamilton- Jacobi approaches 
in classical mechanics. 

Let X be an n-dimensional projective subvariety of an V-dimensional pro- 
jective space P, and let X be the dual variety of X in the dual projective space 
P. Since various kinds of geometrically meaningful unusual behavior of hy- 
perplane sections are manifested more explicitly in terms of dual varieties, it 
makes sense to consider their natural invariants. The simplest invariant of X 
is its dimension h. “Typically”, h = N — 1, i.e., A is a hypersurface. The 
deviation from the “typical” behavior admits a geometric interpretation: if 
X is not a hypersurface and, say, codim A = s -I- 1, then A is uniruled by 
s-planes. 

Assume that A is a smooth variety not contained in a hyperplane. Then 
n ^ h, by [Z, Chapter 1]. If the extremal case n = h holds and n = h < 2A/3, 
then, by [Eil], [Ei2], such A are classified by the following list: 

* Partly supported by ESI, Vienna, Austria and ETH, Zurich, Switzerland. 

** Partly supported by ESI, Vienna, Austria. 
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(i) hypersurfaces, 

(ii) X embedded in p2"-i by the Segre embedding, 

(iii) the Grassmannian of lines in P"^ embedded in P® by the Pliicker map, or 

(iv) the 10-dimensional spinor variety of 4-dimensional linear subspaces on 
a nonsingular 8-dimensional quadric in P^®. 

According to Hartshorne’s famous conjecture, if n > 2N/3, then X is a 
complete intersection, and hence, by [Ei2], X is a hypersurface. Therefore 
it is plausible that the above-stated list contains every smooth X such that 
n = h. Furthermore, in cases (ii), (iii) and (iv), the variety X is self-dual in 
the sense that, as an embedded variety, X is isomorphic to X. In case (i), it is 
self-dual if and only if it is a quadric. Thus, modulo Hartshorne’s conjecture, 
the above-stated list gives the complete classification of all smooth self-dual 
projective algebraic varieties. In particular it shows that there are not many 
of them. 

In [P2], it was found a method for constructing many nonsmooth self- 
dual projective algebraic varieties. It is related to algebraic transformation 
groups theory: the self-dual projective algebraic varieties appearing in this 
construction are certain projectivized orbit closures of some linear actions of 
reductive algebraic groups. We recall this construction. 

Let G be a connected reductive algebraic group, let P be a finite di- 
mensional algebraic G-module and let i? be a nondegenerate symmetric G- 
invariant bilinear form on V. We assume that the ground field is C. For a 
subset S of V, put S'-*- := {u G P | B{v,s) = 0 V s G S}. We identify P 
and V* by means of B and denote by P the associated projective space of 
V = V*. Thereby the projective dual X of a Zariski closed irreducible subset 
X of P is a Zariski closed subset of P as well. Let A/’(P) be the null-cone of 

V, i.e., 

J\f(V) :={vGP|0gG-u}, 

where bar stands for Zariski closure in P. 

Theorem 1. ([P2, Theorem 1]) Assume that there are only finitely many G- 
orbits in N{V). Let v G Af{V) he a nonzero vector and let X := P(G • w) C P 
he the projectivization of its orbit closure. Then the following properties are 
equivalent: 

(i) X = X. 

(ii) (Lie(G) • v)-L CAf{V). 

Among the modules covered by this method, there are two naturally allo- 
cated classes, namely, that of the adjoint modules and that of the isotropy 
modules of symmetric spaces. In fact the first class is a subclass of the second 
one; this subclass has especially nice geometric properties and is studied in 
more details. Projective self-dual algebraic varieties associated with the ad- 
joint modules by means of Theorem 1 were explicitly classified and studied in 
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[P2]. In particular, according to [P2], these varieties are precisely the projec- 
tivized orbit closures of nilpotent elements in the Lie algebra of G that are 
distinguished in the sense of Bala and Carter (see below Theorem 2). This 
purely algebraic notion plays an important role in the Bala-Carter classifica- 
tion of nilpotent elements, [BaCa] . 

For the isotropy modules of symmetric spaces, in [P2] it was introduced the 
notion of {—!)- distinguished element of a Z 2 -graded semisimple Lie algebra 
and shown that the projective self-dual algebraic varieties associated with such 
modules by means of Theorem 1 are precisely the projectivized orbit closures 
of (— l)-distinguished elements. Thereby classification of such varieties was 
reduced to the problem of classifying (—1 (-distinguished elements. In [P2], 
it was announced that the latter problem will be addressed in a separate 
publication. 

The goal of the present paper is to give the announced classification: here 
we explicitly classify (— l)-distinguished elements of all Z 2 -graded complex 
semisimple Lie algebras; this yields the classification of all projective self-dual 
algebraic varieties associated with the isotropy modules of symmetric spaces 
by means of the above-stated construction from [P2]. In the last section we 
briefly discuss some geometric properties of these varieties. 

Notice that there are examples of singular projective self-dual algebraic 
varieties constructed in a different way. For instance, the Kummer surface in 
P^, see [GH], or the Coble quartic hypersurface in P’^, see [Pa], are projective 
self-dual. A series of examples is given by means of “Pyasetskii pairing”, [T] 
(e.g., projectivization of the cone of n x m-matrices of rank ^ n/2 is projective 
self-dual for n ^ m, n even). 

Given a projective variety, in general it may be difficult to explicitly iden- 
tify its dual variety. So our classification contributes to the problem of finding 
projective varieties X for which X can be explicitly identified. Another appli- 
cation concerns the problem of explicit describing the projective dual varieties 
of the projectivized nilpotent orbit closures in the isotropy modules of sym- 
metric spaces: our classification yields its solution for all (— l)-distinguished 
orbits. To the best of our knowledge, at this writing this problem is largely 
open; even finding the dimensions of these projective dual varieties would be 
interesting (for the minimal nilpotent orbit closures in the adjoint modules, a 
solution was found in [KM]; cf. [Sn] for a short conceptual proof). 



2 Main Reductions 

Let g be a semisimple complex Lie algebra, let G be the adjoint group of g, 
and let 6 G Aut g be an element of order 2. We set 

t := {x e g I 0(x) =x}, p := {x G g I 6»(x) = -x}. (1) 

Then J and p yf 0, the subalgebra t of g is reductive, and g = t © p is a 
Z 2 -grading of the Lie algebra g, cf., e.g., [OV]. Denote by G the adjoint group 
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of g. Let K be the connected reductive subgroup of G with the Lie algebra 
it is the adjoint group of 6. 

Consider the adjoint G-module g. Its null-cone A/”(g) is the cone of all 
nilpotent elements of g; it contains only finitely many G-orbits, [D], [Kl]. The 
space p is AT-stable, and we have 

A/'(P) =Af(g)np. 

By [KR], there are only finitely many RT-orbits in N{p) and 

2 dimj;, K ■ X = dim^ G • x for any x € A/’(p). (2) 

The Killing form Bg of g (resp., its restriction Bg\p to p) is symmetric 
nondegenerate and G-invariant (resp., K-invariant). We identify the linear 
spaces g and g* (resp., p and p*) by means of Bg (resp., Bglp). 

Recall from [BaCa], [Ca] that a nilpotent element x G A/"(g) or its G-orbit 
G • X is called distinguished if the centralizer 3 g(x) of x in g contains no 
nonzero semisimple elements. According to [P2], distinguished orbits admit 
the following geometric characterization: 

Theorem 2. ([P2, Theorem 2]) Let O be a nonzero G-orbit in A/’(g) and 
X := P(G). The following properties are equivalent: 

(i) X = X, 

(ii) O is distinguished. 

Hence the classification of distinguished elements obtained in [BaCa] yields 
the classification of projective self-dual orbit closures in P(Af(g)). This, in 
turn, helps studying geometric properties of these projective self-dual projec- 
tive varieties, [P2]. 

There is a counterpart of Theorem 2 for the action of K on p. Namely, if 
X G p, then 3 g(x) is 0-stable, hence it is a graded Lie subalgebra of g, 

3s(a;) = 3e(a;) ©3p(a;), where 3 t(x) := 3 g(x) n 6, 3 p(x) := 3 g(x) n p. 

Definition 1. ([P2]) An element x G A/"(p) and its RT-orbit are called (— 1)- 
distinguished if 3 p(x) contains no nonzero semisimple elements. 

Remark. It is tempting to use simpler terminology and replace “(— l)-distin- 
guished” with merely “distinguished” . However this might lead to the ambigu- 
ity since, as it is shown below, there are the cases where x is (— l)-distinguished 
with respect to the action of RT on p but x is not distinguished with respect 
to the action of G on g. 

Notice that since p contains nonzero semisimple elements (see below the 
proof of Theorem 7), every (— l)-distinguished element is nonzero. 

Theorem 3. ([P2, Theorem 5]) Let O be a nonzero K-orbit in M{p) and 
X := P(G). The following properties are equivalent: 
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(i) X = X. 

(ii) O is {—!)- distinguished. 

By virtue of Theorem 3, our goal is classifying (— l)-distinguished orbits. 

Theorem 4. Let O be a K -orbit in M{p) and let x be an element of O. The 
following properties are equivalent: 

(i) O is {—!)- distinguished. 

(ii) The reductive Levi factors o/ 3 e(x) and ^g{x) have the same dimension. 

(iii) The reductive Levi factors o/ 3 e(x) and i^{x) are isomorphic. 

If 0 = 1) 0 1) where f) is a semisimple complex Lie algebra, and 0{{y, z)) = 
{z,y), then 

® = {(y,j/) I j/G P = {{y,-y)\y&^}- (3) 

If H is the adjoint group of (), then (3) implies that K is isomorphic to H 
and the iL-module p is isomorphic to the adjoint iJ-module (). Therefore, for 
y G Al'(t)), the variety P(K ■ y) is projective self-dual if and only if the variety 
P{H ■ x) for X := {y, —y) G A/’(p) is projective self-dual. This is consistent with 
Theorems 2 and 3: the definitions clearly imply that x is (— l)-distinguished 
if and only y is distinguished. So Theorem 2 follows from Theorem 3. 

In [N] , it was made an attempt to develop an analogue of the Bala-Carter 
theory for nilpotent orbits in real semisimple Lie algebras. The Kostant- 
Sekiguchi bijection (recalled below in this section) reduces this to finding an 
analogue of the Bala-Carter theory for iL-orbits in Af(p). Given the above dis- 
cussion, we believe that if such a natural analogue exists, (— l)-distinguished 
elements should play a key role in it, analogous to that of distinguished el- 
ements in the original Bala-Carter theory (in [N], the so called noticed ele- 
ments, different from (— l)-distinguished ones, play a central role). 

Theorems 3, 4 and their proofs are valid over any algebraically closed 
ground field of characteristic zero. They give a key to explicit classifying (— 1)- 
distinguished elements since there is a method (see the end of this section) 
for finding reductive Levi factors of 3 e(x) and 3 g(x). 

However, over the complex numbers, there is another nice characterization 
of (— l)-distinguished orbits. It is given below in Theorem 5. For classical g, 
our approach to explicit classifying (— l)-distinguished orbits is based on this 
result. The very formulation of this characterization uses complex topology. 
However remark that, by the Lefschetz’s principle, the final explicit classifica- 
tion of (— l)-distinguished orbits for classical g given by combining Theorem 
5 with Theorems 8-13 is valid over any algebraically closed ground field of 
characteristic zero. 

Namely, according to the classical theory (cf., e.g., [OV]), there is a 0-stable 
real form g^ of g such that 



0 B = 6 r ® PR> where tg := gg C t, pR := Pr C p. 



(4) 
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is a Cartan decomposition of The semisimple real algebra is noncompact 
since p ^ 0- Assigning to 6 induces well defined bijection from the set of 
all conjugacy classes of elements of order 2 in Ant g to the set of conjugacy 
classes of noncompact real forms of g. If x is an element of g^, we put 

3g,(a;) := 0Rn30(a;); 

3 g^(x) is the centralizer of x in gjj. The identity component of the Lie group 
of real points of G is the adjoint group Ad(gjj) of g^. We set 

(Sr) •= (s) 0R- 

Definition 2. An element x G A/’( 0 r) is called compact if the reductive Levi 
factor of its centralizer 3gj,(a;) is a compact Lie algebra. 

Recall that there is a bijection between the sets of nonzero AT-orbits in 
Af{p) and nonzero Ad(g]j)-orbits in cf. [CM], [Mj. Namely, let cr be the 

complex conjugation of g defined by g^, viz., 

a(a + ib) = a — ib, a,b G gjj. 

Let {e,h,f} be an sl 2 -triple in g, i.e., an ordered triple of elements of g 
spanning a three-dimensional simple subalgebra of g and satisfying the bracket 
relations 

[h, e] = 2e, [h, f] = -2/, [e, /] = h. (5) 

It is called a complex Cayley triple if e, / G p (hence h G t) and a{e) = —f. 
Given a complex Cayley triple {e, h, /}, set 

e' := i{-h + e + f)/2, h':=e-f, f' := -i{h + e + f)/2. (6) 

Then {e', /i', /'} is an s^-triple in g^ such that 9{e') = f (and hence 0{f) = 
e', 0{h') = —h'). The s^-triples in g^ satisfying the last property are called the 
real Cayley triples. Given {e',/i',/'}, the following formulas restore {e, /i, /}: 

e := {h' + if - ie')/2, h:=i{e' + f), f := {-h' + if - ie')/2. (7) 

The map {e, h, /} |e', h' , /'} is a bijection from the set of complex to the 

set of real Cayley triples. The triple {e,h,f} is called the Cayley transform 
of {e',h',f}. 

Now let O be a nonzero AT-orbit in Af{p). Then, according to [KR], there 
exists a complex Cayley triple {e, h, /} in g such that e G O. Let {e', h' , /'} 
be the real Cayley triple in g^ such that {e, h, /} is its Cayley transform. Let 
O' = Ad(gjj)-e'. Then the map assigning O' to O is well defined and establishes 
a bijection, called the Kostant-Sekiguchi bijection, between the set of nonzero 
AT-orbits in Af{p) and the set of nonzero Ad(gjj)-orbits in We say 

that the orbits O and O' correspond one another via the Kostant-Sekiguchi 
bijection. One can show, [KR], cf. [CM], that 

G-e' = G-e, 

dimR Ad(gR)-e' = dime G-e'. 



(8) 
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Theorem 5. Let O he a nonzero K-orbit in Af{p) and let x he an element 
of the Ad{2gf)~ orbit in corresponding to O via the Kostant-Sekiguchi 

bijection. The following properties are equivalent: 

(i) O is (—1) -distinguished. 

(ii) X is compact. 

Next result, Theorem 6, reduces studying projective self-dual varieties as- 
sociated with symmetric spaces to the case of simple Lie algebras g. Namely, 
since the Lie algebra g is semisimple, it is the direct sum of all its simple 
ideals. As this set of ideals is 0-stable, g is the direct sum of its 0-stable ideals, 
g = gi © • • • © gd, where each g; is either 

(a) simple or 

(b) direct sum of two isomorphic simple ideals permuted by 0. 

Let Gi, t[, pi, Ki and A/’(pz) have the same meaning for g; with respect to 
0; := 0|g, as resp., G, 6, p, K and A/’(p) have for g with respect to 0. Then 
G = Gi X ... X Gd, t © . . . © 6d, p = pi © ... © pd, K = Ki x . . . x Kd 
and A/'(p) = A/’(pi) x . . . x A/’(pd). 

In Theorem 6, we use the following notation. Let Xi , . . . , be the closed 
subvarieties of a projective space P, and let s ^ 2. Consider the variety 

{(xi, . . . ,Xs,i/) G Ai X . . . X As X P I dim(xi, . . . ,Xs) = s - 1, y € (xi, . . . ,Xs)}, 

(9) 

where bar denotes Zariski closure in Ai x . . . x A^ x P and (S) denotes the 
linear span of S' in P. Consider the projection of variety (9) to P. Its image 
is denoted by 

Join(Ai,...,As) (10) 

and called the join of Ai, . . . , Xg. If s = 2, then (10) is the usual join of Ai 
and A 2 , cf. [Ha]. If s > 2, then (10) is the usual join of Join(Ai, . . . , Ag_i) 
and As. 

Theorem 6. Let x = xi + . . . + Xd where x; G N{pi), I = 1, . . . ,d. Consider 
in P(g) the projective subvarieties X := P{K ■ x) and Xi := P{Ki • xi). Then 

A = Join(Ai,...,Ad) 

and the following properties are equivalent: 

(i) A = A. 

(ii) A; = Xi for all 1. 

Remark. This is a specific geometric property of the considered varieties. In 
general setting, projective self-duality of Join(Zi, . . . , Zm) is not equivalent to 
projective self-duality of all Zi, . . . , Zm. 
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If Qi is of type (b), viz., qi is isomorphic to the direct sum of algebras s0s, 
where s is a simple algebra, and 9i acts by 9i{{x, y)) = {y, x), then, as explained 
above (see (3)), classifying (— l)-distinguished orbits in Af(pi) amounts to 
classifying distinguished orbits in Af(s). Since the last classification is known, 
[BaCa], [Ca], this and Theorem 6 reduce classifying (— l)-distinguished orbits 
in g to the case where g is a simple Lie algebra. 

In this case, for explicit classifying (— l)-distinguished orbits, one can apply 
Theorem 4 since there are algorithms, [Ka], [Vi], yielding, in principle, a clas- 
sification of AT-orbits in Af{p) and a description of the reductive Levi factors of 
ii{x) and 3 g(a;) for x G Af(p). Moreover, there is a computer program, [L], im- 
plementing these algorithms and yielding, for concrete pairs (g, 0), the explicit 
representatives x of AT-orbits in N{p) and the reductive Levi factors of 3 e(x) 
and 3 g(x). There is also another way for finding representatives and dimen- 
sions of it'-orbits in A/”(p): they may be obtained using the general algorithm 
of finding Hesselink strata for linear reductive group actions given in [P3], 
since in our case these strata coincide with AT-orbits, see [P3, Proposition 4]. 

Fortunately, for exceptional simple g, explicit finding of the aforementioned 
classification and description already has been performed by D. Z. Boko vie in 
[D3], [D4], cf. [CM]. In these papers, the answers are given in terms of the 
so called characteristics in the sense of Dynkin (in Section 5, we recall this 
classical approach, [D], [Kl], [KR], cf. [CM] and [Vi]). Combining either of 
Theorems 4 and 5 with these results, we obtain, for all exceptional simple g 
and all 9, the explicit classification of (— l)-distinguished iF-orbits in Af{p) in 
terms of their characteristics (see Theorem 14). 

For classical g, we use another approach and obtain the classification of 
(— l)-distinguished iF-orbits in Af{p) by means of the Kostant-Sekiguchi bi- 
jection. Theorem 5 and elementary representation theory of SI 2 (see Theorems 
8-13). 

Theorems 4, 5, 6 are proved in Section 3. For simple Lie algebras g, the 
classifications of (— l)-distinguished iF-orbits in Af{p) are obtained in the next 
two sections: in Section 4, we consider the case of classical g, and in Section 5, 
that of exceptional simple g. In Section 6, we briefly discuss some geometric 
properties of the constructed self-dual projective algebraic varieties. 
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3 Proofs Of Theorems 4—6 

Proof of Theorem 4- Theorem 4 immediately follows from Theorem 7 proved 
below. 

Let fc be a field of characteristic 0. If c is a finite dimensional algebraic Lie 
algebra over k, we denote by rad c (resp., rad„c) the radical (resp., the unipo- 
tent radical, i.e., the maximal ideal whose elements are nilpotent) of c. We 
call c/rad c (resp., c/raduc) the Levi factor (resp., the reductive Levi factor) 
of c. According to [Ch], there is a semisimple (resp., reductive) subalgebra 1 
in c such that c is the semidirect sum of 1 and rad c (resp., rad„c). Every such 
[ is called Levi subalgebra (resp., reductive Levi subalgebra) of c. 

Theorem 7. Assume that k is algebraically closed and let a be a finite dimen- 
sional algebraic Lie algebra over k. Let 9 G Aut a be an element of order 2. 
For any 9-stable linear subspace 1 of a, set 

b*" = {xGl I 9{x) = ±x}. 

The following properties are equivalent: 

(i) a“ contains no nonzero semisimple elements. 

(ii) a“ = (rad„a)~. 

(iii) dima“ = dim(rad„a)“. 

(iv) a” C rad„a. 

(v) The reductive Levi factors of a+ and a have the same dimension. 

(vi) The reductive Levi factors of o+ and a are isomorphic. 

(vii) The set of all reductive Levi subalgebras of coincides with the set of 
all 9-stable reductive Levi subalgebras of o. 

Proof. It is known that a contains a 0-stable Levi subalgebra s (e. g., see [KN, 
Appendix 9]), and rad a contains a 0-stable maximal torus t, see [St]. Thus we 
have the following 0-stable direct sum decompositions of vector spaces: 

a = s©rada, rado = t©rad„a, 'I 

s = s+©s“, t=P©t“, rad„a = (rad„a)+ © (rad„a)“, > (11) 

© P © (rad„a)*. J 

(i) (ii): Assume that (i) holds. Then, by (11), we have t“ = 0. If s~ yf 0, 
then 0|^ G Aut a is an element of order 2. By [Vu], this implies that s“ contains 
a nonzero 0-stable algebraic torus. By (11), this contradicts (i). Thus s“ = 0. 
Whence (ii) by (11). 

(ii) (i) and (iv) (i): This is because all elements of rad^a are nilpo- 
tent. 

(ii) (iii) and (ii) (iv): This is evident. 

(iii) (ii): This follows from (11). 

(ii) (v): It follows from (11) that (ii) is equivalent to 
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s 0 tCa+. ( 12 ) 

Assume that (12) holds. Let tt : o ^ a/rad„a be the natural homomorphism. 
By (11), (12), we have 7 r(a+) = a/rad„a. Since the algebra a/rad„a is reduc- 
tive, this implies 

dima/rad„a ^ dimension of reductive Levi subalgebras of a'*' 

= dima+/rad„(a^). 

On the other hand, since reductive Levi subalgebras of a and a'*" are precisely 
their maximal reductive subalgebras, cf., e.g., [OV] , the inclusion C a 
implies 



dima/rad„a = dimension of reductive Levi subalgebras of o 
^ dimension of reductive Levi subalgebras of a^. 



(14) 



Now (v) follows from (13), (14). 

(v) (ii): Assume that (v) holds. Let 1 be a reductive Levi subalgebra of 
a"*". Since reductive Levi subalgebras of o are precisely its maximal reductive 
subalgebras, it follows from (v) that I is a reductive Levi subalgebra of o as 
well. Let s and t be resp. the derived subalgebra and the center of 1; so we have 
1 = s 0 1. Then s is a 0-stable Levi subalgebra of a, and t is a 0-stable maximal 
torus of rad a. Hence, as above, (ii) is equivalent to the inclusion (12). As the 
latter holds by the very construction of [, we conclude that (ii) holds as well. 

(vii) (v): This is clear. 

(i) (vii): Let I be a 0-stable reductive Levi subalgebra of a. If [“ yf 0, 
then 0|[ G Aut [ is an element of order 2. Hence, by [Vu], there is a nonzero 
0-stable algebraic torus in [“. This contradicts (i). Whence = 0, i.e., ( lies 
in a+. 

(vi) (v) and (vii) (vi): This is clear. □ 



Proof of Theorem 5. According to [KR], there is a complex Cayley triple 
{e, h, /} in g such that O = K ■ e. Let |e', h' , /'} be the real Cayley triple in 
whose Cayley transform is {e, /i, /}. Since O' = Ad(gg) • e', we may, and 
will, assume that x = e' . 

Let s (resp., %) be the simple three-dimensional subalgebra of g (resp., 
gjj) spanned by {e,hj} (resp., {e',h',f}), 



s = Ce + Ch + Cf, Sr = Ke' 0 K/i' 0 K/'. (15) 



Denote by 3 g(s) (resp., 30 ^(%)) the centralizer of s (resp., Sg) in g (resp., 
5r)- 



It follows from ( 6 ), (7), (15) that Sg is a real form of s. Since g^ is a real 
form of g, this yields that jg (s^) is a real form of 3 g(s). The definitions of 
complex and real Cayley triples imply that s and Sjj are 0-stable subalgebras. 
Therefore 3 g(s) and 30 jj(Sjj) are 0-stable as well. Whence 
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30(s) = (30(s)nt)©(3g(s)np), 

30J,(%) = (3gj,(%) Jr) © (3gj,(%) Pb)> 

20(5) n 6 = C(3g^(sR) n 6 r), 3g(s) P = C(3g^(sR) n Pr). ( 17) 

Now take into account that 3g(s) (resp., 30 j,(Sr)) is the reductive Levi sub- 
algebra of 3g(e) (resp., 3g,(e')): regarding 35(5), see, e.g., [SpSt]; for 30«(%), 
the arguments are the same. Hence, by Theorem 7, the orbit O is (— 1)- 
distinguished if and only if 3g(s) n p = 0. By (17), the latter condition is 
equivalent to 30j,(%) n pR = 0. On the other hand, since (4) is the Cartan 
decomposition of 0r, it follows from (16) that 30^(%) n pR = 0 if and only if 
the Lie algebra 3g (Sr) is compact. This completes the proof of Theorem 5. 
□ 

Proof of Theorem 6. Clearly the following proposition implies the first state- 
ment. 

Proposition 1. ([P2, Proposition 2]) Let Ht he an algebraic group and let Lt 
he a finite dimensional algebraic Ht-module, t = 1, 2. Let Vt & Lg be a nonzero 
vector such that the orbit Ht ■ Vt is stable with respect to scalar multiplications. 
Put H := Hi X H2, L := Li (B ©2- Identify Lt with the linear subspace of L 
and set v := v\ + V2- Then 

P(iJ . v) = Join(P(iJi • vi),V{H2 ■ V2)). 

Regarding the second statement, notice that the centralizers and 

3g(x) are resp. 0;- and d-stable and 3p(x) = 3pi(xi) © ... © 3p^(a;d). Now the 
claim follows from this decomposition, Definition 1 and Theorem 3. □ 



4 Classification For Classical g 

If g is classical, our approach to classifying (— l)-distinguished nilpotent K- 
orbits in p is based on the Kostant-Sekiguchi bijection and Theorem 5. 
Namely, for every noncompact real form gg of g, we will find in all 

Ad(gR)-orbits O whose elements are compact. If this is done, then for the 
complexification of a Cartan decomposition of gR, the iL-orbits in A/"(p) cor- 
responding to all such O via the Kostant-Sekiguchi bijection are precisely all 
(— l)-distinguished orbits. 

First we recall the classification of real forms gg of classical complex Lie al- 
gebras g. Let D be either real numbers M, complex numbers C, or quaternions 
H. If a G D, we denote by a the conjugate of a. Let P be a finite dimensional 
vector space over D (left D-module). Denote by GLd{V) the Lie group of all 
D-linear automorphisms of V. Its Lie algebra g[£)(P) is identified with the 
real Lie algebra of all D-linear endomorphisms of V. The derived algebra of 
gljo(V) is denoted by sl£>(V). 

Let a map ^ : V x V ^ L> be D-linear with respect to the first argument. 
It is called 
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• symmetric bilinear form on V if y) = <P{y, x) for all x,y G V, 

• skew-symmetric bilinear form on V if ^{x, y) = —<P{y, x) for all x,y G V, 

• Hermitian form on V if <P{x, y) = ^{y, x) for all x,y G V, 

• skew-Hermitian form on V if <P{x, y) = —^{y, x) for all x,y & V. 

By “form on V” we always mean form of one of these four types. A form 
on V is called nondegenerate if, for any x G V, there is y G V such that 
d^{x, y) yf 0. If <Ps, s = 1, 2, is a form on a finite dimensional vector space Vg 
over D, then and ^2 are called equivalent forms if there exists an isometry 
Ip : V\ ^ V2 with respect to and d>2, i.e., an isomorphism of vector spaces 
over D such that <l’2{'f’{x),ip{y)) = <l>i{x,y) for all x,y G Vi. 

The automorphism group of a form (p on V, 

GL|,(I^) := {9 G GLd(V) \ <P{g ■ x,g ■ y) = <P{x, y) for all x,y G V}, 



is a Lie subgroup of GLd{V) whose Lie algebra is 

q{%{V) := {A G 0[n(G) | ■ x,y) + P{x,A- y) = 0 for all x,y G V}. 

For ^ = 0 (zero form), we have GLf,(V) = GIjd{V) and qI%,{V) = 01d(G). 

Let n := dimu V and let (e) := {ei,...,e„} be a basis of V over D. 
Identifying H-linear endomorphisms of V with their matrices with respect to 
(e), we identify 01 d(G), 5[d{V) and g[f,(V) with the corresponding matrix 
real Lie algebras. For U = R, H, the real Lie algebras and bId{V) are 

denoted resp. by g[„(D) and sl„(I?), and for D = C, by 0 I„(C)r and sI„(C)r. 
The last algebras are endowed with the natural structures of complex Lie 
algebras that are denoted resp. by and sl„(C). If I? = H, then V is a 

2n-dimensional vector space over the subfield C of H, and elements of gljj(14) 
are its C-linear endomorphisms. Identifying them with their matrices with 
respect to the basis Ci, . . . ,e„,jei, . . . ,je„, we identify 0t„(EI) (resp., sI„(H)) 
with the corresponding Lie subalgebra of 012 „(C)r (resp., sl2n(C)R). 

If is a form on V , then the matrix (<?st) of <P with respect to (e) defines 
<? by 







n 

s,t—l 



n 

s,t—l 



Xs^stVt 

Xs^styt 



if <P is symmetric or skew-symmetric, 
if <P is Hermitian or skew-Hermitian. 



The map <P 1— > {'Pst) is a bijection between all symmetric (resp., skew- 
symmetric, Hermitian, skew-Hermitian) forms on V and all symmetric (resp., 
skew-symmetric, Hermitian, skew-Hermitian) n x n-matrices over D. P is non- 
degenerate if and only if {Pgt) is nonsingular. 

We denote by I,; the unit matrix of size d and put Ip^q := diag(l, . . . , 1, — 1, 
. . . , —1) where p (resp., q) is the number of I’s (resp., — I’s). 

Now we summarize the results from linear algebra about classification of 
forms and fix some notation and terminology. In the sequel, N denotes the set 
of all nonnegative integers. 
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Symmetric Bilinear Forms 

I? = M. There are exactly n-l-1 equivalence classes of nondegenerate symmetric 
bilinear forms on V. They are represented by the forms ^ with (t^st) = ip,g, 
p + g = n, p = 0,...,n. If {^st) = Ip,g, then sgntP := p — q is called the 
signature of and the real Lie algebra is denoted by 50p^q. 

D = C. There is exactly one equivalence class of nondegenerate symmetric 
bilinear forms on V. It is represented by the form <P with {<Pst) = In- The 
corresponding real Lie algebra Ql%(y) is denoted by so„(C)r. It has a natural 
structure of complex Lie algebra that is denoted by so„(C). 

_D = H. There are no nonzero symmetric bilinear forms on V. 

Skew-symmetric Bilinear Forms 

D = M. and C. Nondegenerate skew-symmetric bilinear forms on V exist if 
and only if n is even. In this case, there is exactly one equivalence class 
of such forms. It is represented by the form with ($st) = -i ■ 

Corresponding real Lie algebra is denoted by sp„(K) for D = M, 

and by sP„(C)r for D = C. The algebra sP„(C)r has a natural structure of 
complex Lie algebra that is denoted by sp„(C). 

D = H. There are no nonzero skew-symmetric bilinear forms on V. 

Hermitian Forms 

D = R. Hermitian forms on V coincide with symmetric bilinear forms. 

D = C and H. There are exactly n+ 1 equivalence classes of nondegenerate 
Hermitian forms on V. They are represented by the forms (P with (Pst) = Ip, 5 , 
p+q = n, p = 0, . . . , n. If (<Pst) = Ip,<j, then sgn<P := p—q is called the signature 
of <P, and the real Lie algebra is denoted by sUp^q for D = C, and by 

spp^q for D = M. 

Skew-Hermitian Forms 

I? = M. Skew-Hermitian forms on V coincide with skew-symmetric forms. 

D = C. The map <P i<P is a, bijection between all nondegenerate Hermi- 
tian forms on V and all nondegenerate skew-Hermitian forms on V . 

D = H. There is exactly one equivalence class of nondegenerate skew- 
Hermitian forms on V . It is represented by the form <P with {Pst) = fln- The 
corresponding real Lie algebra q(o{V) is denoted by u* (H). 

Some of the above-defined Lie algebras are isomorphic to each other. Ob- 
viously sUp^q = suq^p, sOp^q = sOq^p, spp q = spg p and we also have 
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SO2 = U*(H), 503(C) ~ 512(C) = 5p2(C), 503 ~ 5U2 = 5pi,o = 511(11), 

S 0 i ^2 — 5Ui^l ~ 5l2(R) = 5p2(]S); 504 (C) ~ Sl 2 (C) 0 5l2(C), 

5O4 ~ 5U2 0 5U2, 50i^ 3 ~ 5b (C)r, 502,2 — Sl2(R) 0 Sl2(R), 

U2(H) ~ 5U2 0Sl2(R), 505 (C) ~ 5p4(C),50s ~ 5p2,50i , 4 5pi i, 

502.3 — 5p4(K), 50g(C) ~ 514 (C), 50g — 5U4, 50i,5 ~ 5l2(EI), 

502.4 5U2,2, 503,3 - 5l4(K), U3(H) ~ 5Ui,3, U4(EI) ~ 502,6- 

By definition, classical complex Lie algebras g are the algebras 5l„(C), 
50„(C) and 5p„(C). According to E. Cartan’s classification (cf., e.g., [OV]), 
up to isomorphism, all their real forms g^ are listed in Table 1. 



Table 1. 



0 










Qr 




compact gj{ 












sin 








sl„(C), 


11 ^ 


2 






n = 


21 , 


su„ 


SU„,o 










su„. 


9 = O 5 1 ? 


...,[n/2] 






so„(C), n = 


3 or 


n 


^ 5 


S0„- 


9 = 0? I5 • 
ur(H), n = 


..,[n/ 2 ], 

21 


so„ 


•= 50„,o 


5p„(C), n 


= 21 




2 


SPi- 


SPnW. 


[ 1 / 2 ] 


5Pi 


:=5pi,o 



There are the isomorphisms between some of the g^’s in Table 1 given 
by (18). 

Now we restate the classification of nilpotent Ad(gjj)-orbits in all real forms 
g^ of classical complex Lie algebras g (cf. [BoCu], [CM], [SpSt], [M], [W]) in 
the form adapted to our goal of classifying compact nilpotent elements in gjj. 

If a subalgebra of g^ is isomorphic to 5l2(K), we call it an sl 2 {R)-subalgebra. 
We use the following basic facts, cf. [CM], [KR], [M], [SpSt]: 

(FI) For any nonzero nilpotent element x G g^, there is an 5l2(R)- 
subalgebra of g^ containing x. 

(F2) If ai and U 2 are the 5[2(R)-subalgebras of g^, and a nonzero nilpotent 
Ad(gg)-orbit intersects both ai and a 2 , then a 2 = g ■ ai for some g € Ad(gg). 

(F3) There are exactly two nonzero nilpotent Ad(5l2(R))-orbits in 5l2(R). 
Scalar multiplication by —1 maps one of them to the other. 

(F4) Any finite dimensional 5[2(R)-D-module is completely reducible. For 
any integer d G N, there is a unique, up to isomorphism, d-dimensional simple 
5l2(R)-D-module Sd- The module Si is trivial. Let Tm be the direct sum of 
m copies of Si, and Tq := 0. 

(F5) If a is an 5l2(R)-subalgebra of g^ and cc G a is a nonzero nilpotent 
element, then ^^^^(a) is the reductive Levi subalgebra of 3 gja;). 
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(F6) If there is a nonzero sl 2 (K)-invariant form on Sd of a given type 
(symmetric, skew-symmetric, Hermitian or skew-Hermitian), it is nondegen- 
erate and unique up to proportionality. We fix such a form. Table 2 contains 
information about its existence and the notation for the fixed forms. 



Table 2. 



D 


d 


symmetric 


sgn 


skew— 

symmetric 


Hermitian 


sgn 


skew- 

Hermitian 


R 


even 

odd 




1 










C 


even 

odd 






^7 




0 

1 


i^d 


H 


even 

odd 








^d 


1 





Partitions, sl2(R)-i^- modules, and sl2(R)-invariant Forms 

We call any vector 

m = (toi, . . . , TOp) e N^, where rup yf 0, (19) 

a partition of the number 

\m\ := 

(this is nontraditional usage of the term “partition” but it is convenient for 
our purposes). If p = 1 , then m is called a trivial partition. 

The Young diagram of m, is a left-justified array Y(m) of empty boxes 
with p boxes in each of the first rrip rows, p — 1 boxes in each of the next rup-i 
rows, and so on. The partition 

rh = {mi, . . . ,mq} 

is called the transpose partition to m if Y(m) is the transpose of Y{m), 
i.e., the rows of Y(rh) are the columns of Y{m) from left to right. We have 
|m| = \m\. 

Let m, be a nontrivial partition. It is called a symmetric (resp., skew- 
symmetric) partition of |m,| if mu in (19) is even for every even (resp., odd) d. 

Let m be a sequence obtained from m by replacing mu in (19) for every 
d (resp., every odd d, every even d) with a pair {pd,<ld) G such that pd + 
qd = md- Such rn is called a fine (resp., fine Hermitian, fine skew-Hermitian) 
partition of \m\ associated with m. If m is fine or fine Hermitian, 



sgnm:= Ed odd {Pd ~ Qd) 



( 20 ) 
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is called the signature of m. If m is fine Hermitian (resp., fine skew-Hermitian) 
and m is symmetric (resp., skew-symmetric), then m is called a, fine symmet- 
ric (resp., fine skew- symmetric) partition of |m|. 

Any partition (19) defines the |m,|-dimensional s[ 2 (R)-D-module 

Vrrx-.= ®a^,iTm,®Sa) ( 21 ) 

(tensor product is taken over D, with respect to the canonical H-bimodule 
structure on 11- vector spaces). By (F4), any nonzero finite dimensional sl 2 (R)- 
H-module is isomorphic to Vm for a unique m. It is trivial if and only if m 
is trivial. 

Identifying every ip e with the transformation of Vm acting as 

0 id on the summand <8> Sd and as 0 on the other summands in the 
right-hand side of (21), we identify 0d^i with the subalgebra of 

fllD(^m)- 

Two sl 2 (M)-invariant forms on Vm are called 5l2(S.)- equivalent if there is 
an sl 2 (R)-equi variant isometry Vm Vm with respect to them. To describe 
the sl 2 (R)-equivalency classes of sl 2 (R)-invariant forms on Vm, we fix, for 
every positive integer r and pair (p, q) G with p -\- q = r, a nondegenerate 
form on Tr whose notation, type and signature (if applicable) are specified in 
Table 3. 



Table 3. 



D 


symmetric 


sgn 


skew— 

symmetric 


Hermitian 


Sgn 


skew- 

Hermitian 


R 


0“ 


p-q 


0®'’, r even 








C 


0‘ 




0r“ , r even 


0^ 


p-q 




H 








0^ 


p-q 


0‘^ 



According to the above discussion, any nondegenerate form on Tr is equivalent 
to a unique form from Table 3. 

If is a nondegenerate sl 2 (R)-invariant form on Vm, then T\d, its restric- 
tion to the summand Sd in (21), is a nondegenerate sl 2 (R)-invariant 

form of the same type (i.e., symmetric, skew-symmetric, Hermitian or skew- 
Hermitian) as T , and different summands in (21) are orthogonal with respect 
to T. If W is another nondegenerate sl 2 (R)-invariant form on Vm, then T and 
T' are sl 2 (R)-equivalent if and only if 'T\d and 'T'\d are sl 2 (K) -equivalent for 
every d. If, for every d, a nondegenerate sl 2 (R)-invariant form <d>d on TmJ®Sd is 
fixed, and all d>d’s are of the same type, then there is a nondegenerate sl 2 (R)- 
invariant form W on Vm such that T\d = d>d for all d. This reduces describing 
the s [2 (R)-equi valency classes of nondegenerate sl 2 (K)-invariant forms on Vm 
to describing that on ® Sd for all d. For any positive integers r and d, 
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Table 4 describes all, up to sl2(R)-equivalency, nondegenerate s(2(R)-invariant 
forms on Sd (in these tables, p + q = r). 



Table 4. 



d 


symmetric 


sgn 


skew— 

symmetric 


Hermitian 


sgn 


even 


6>r <8) Af 


0 


o;.d ® Af 






odd 


Op,<i ® Ad 


p-q 


er ® AJ 






even 


er ® Af 




0r ® Ay 


0p,q ® Af 


0 


odd 


0r®A% 






p-q 










©*" ® Af 


0 










0p,q ® Af 


p-q 



skew— 

Hermitian 






Returning back to the n-dimensional vector space V over fix a form (p 
(not necessarily nondegenerate) on V. Let m be a nontrivial partition of n 
and let 

Oim ■ sl2(R) 0[_D(km) (22) 

be the injection defining the sl2(K)--D-module structure on Vm- Let be an 
sl2(R)-invariant form on Vm- If ^ and are equivalent and 6 : Vm — > R is 
an isometry with respect to 'P and P, then the image of the homomorphism 

sl2(K) ^ 0[£,(R), Loam{‘P)° 

is an sl2(M)-subalgebra of Qi%{V). The above discussion shows that any sl2(K)- 
subalgebra of Qi%{y) is obtained in this way from some pair The 

sl2(K)-subalgebras of Q^%{V) obtained in this way from the pairs {m,!?'}, 
are GLf,(V)-conjugate if and only if m, = ml, and P and P' 
are sl2(M)-equivalent. This yields a bijection between the union of sl2(R)- 
equi valency classes of sl2(R)-invariant forms equivalent to <P on Vm, where m 
ranges over all nontrivial partitions of n, and the set of all GL^(V)-conjugacy 
classes of sl2(R)-subalgebras in glf,(V). Denote this bijection by *. If P is 
either zero or nondegenerate, considering * leads to the classification of nilpo- 
tent Ad(g[f)(G))-orbits in glf>(V) described below. In each case, we give the 
formulas for the orbit dimensions (one obtains them using (8) and [GM], [M]); 
then (2), (8) yield the dimensions of the corresponding iL-orbits in Af(p). 



• Nilpotent Orbits In sId(V) 

Take P = 0. Then GLf,(V) = GLd(V) and glf,(V) = gloiV)- Any s[2(K)- 
subalgebra of gli)(G) is contained in 51 d{V). For any nontrivial partition m 
of n, consider the GLf,(V)-conjugacy class of sl2(R)-subalgebras in s[_d(R) 
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corresponding under * to the sl2(R)-equivalency class of zero form on Vm- 
Then by (F1)-(F3), [KR], the subset of Q^{V) that is the union of all sl2(R)- 
subalgebras from this class contains a unique nonzero nilpotent GIjd{V)- 
orbit Om- 

Ad(sli)(V))-orbits in A/’(s1_d(R)): 

Om is an Ad(sl_D(R))-orbit, except that Om is the union of 
two Ad(sl£)(R))-orbits Om and Om (that are the connected 
components of Om) ii D — R and rud = 0 for every odd d. 

Such Ad(sIi)(R))-orbits, taken over all partitions m of n, are 
pairwise different and exhaust all nonzero Ad(s[i)(R))-orbits in 

Af(sbCF)). 

Orbit dimensions: 

f dimg Om for D = R, 

- J2d = ■! dime Om for D = C, 

[ dimg Orn, /4 for = H. 



• Nilpotent Orbits In q\%{V) for D — R 
and Nondegenerate Symmetric ^ 



Let m be a fine symmetric partition of n associated with (19). Let 'I'm be 
the sl2(K)-invariant form on Vm such that for all d, 



if is odd, 
0^^ 0 if d is even. 



Then 'I'm is equivalent to <P if and only if 



(23) 



sgn m = sgn I>. (24) 

If (24) holds, consider the GLf,(V)-conjugacy class of sl2(R)-subalgebras in 
0[f,(R) corresponding under * to the sl2(R)-equivalency class of 'I'm- Then by 
(F1)-(F3), [KR], the union of all sl2(R)-subalgebras from this class contains 
a unique nilpotent GLf,(V)-orbit Om- 

Ad(g[f,(V))-orbits in A/'(g[f,(K)): 

If (24) holds, Om is an Ad(g[f,(K))-orbit, except the following 
cases. If nid = 0 for all odd d, then Om is the union of four 
Ad(g[f,(V))-orbits Om: ^m: fho connected 

components of Om- If there is an odd d such that rud yf 0 and 



either 




0 for all d = 1 mod 4, 
0 for all d = 3 mod 4 



or 



Pd = 0 for all d = 3 mod 4, 
qd = 0 for all d = 1 mod 4, 
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then Om is the union of two Ad(glf,(F))-orbits that 

are the connected components of Ora- Such Ad(glf,(V))-orbits, 
taken over all fine symmetric partitions rnoin satisfying (24), 
are pairwise different and exhaust all nonzero Ad(glf,(V))-orbits 
in Af(0lS(F)). 

Orbit dimensions: 

dimjj Orn = {n^ -n~Y.d + Y.d odd ^d) /2. 



• Nilpotent Orbits In qI%{V) for D — C 
and Nondegenerate Symmetric ^ 

Let m be a symmetric partition of n. Let <fVn be the sl 2 (IR)-invariant form 
on Vm such that for all d, 



'I'mAd — 



_ ) 



if d is odd, 
if d is even. 



Then 'Pm is equivalent to Consider the GLf,(V)-conjugacy class of sl 2 (R)- 
subalgebras in glf,(V) corresponding under * to the s [ 2 (R)-equi valency class 
of Pm- Then by (F1)-(F3), [KR], the union of all sl 2 (R)-subalgebras from 
this class contains a unique nilpotent GLf,(V)-orbit Om- 

Ad(g[|,(V))-orbits in A/'(g[f,(R)): 

Om is an Ad(g[f,(V))-orbit, except that if md = 0 for all odd d, 
then Om is the union of two Ad(g[f,(V))-orbits Om £^nd Om 
that are the connected components of Om- Such Ad(glf,(V))- 
orbits, taken over all symmetric partitions m of n, are pair- 
wise different and exhaust all nonzero Ad(g[f,(V))-orbits in 

Orbit dimensions: 

dime C>m = -n-Y.d d^^dd + Y.d odd ^d) /2. 

• Nilpotent Orbits In Qi%{V) for D — 
and Nondegenerate Skew-symmetric ^ 

Let m be a fine skew-symmetric partition of n associated with (19). Let Pm 
be the sl 2 (R)-invariant form on Vm such that for all d, 



Pm.ld — 



if d is even, 
if d is odd. 
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Then 'I'ra is equivalent to Consider the GLf,(V)-conjugacy class of sl 2 (R)- 
subalgebras in q\%{V) corresponding under * to the s [ 2 (R)-equi valency class 
of Ifm- Then by (F1)-(F3), [KR], the union of all sl 2 (R)-subalgebras from 
this class contains a unique nilpotent GLf,(V)-orbit Om- 
Ad(g[f,(V))-orbits in 

Om is an Ad(g[f,(V))-orbit. Such Ad(g[f,(G))-orbits, taken over 
all fine skew-symmetric partitions m of n, are pairwise different 
and exhaust all nonzero Ad(g[f,(G))-orbits in A/’(glf)(G)). 

Orbit dimensions: 

dimjj Om = + n~Y.d ~ Ed odd ^d) /2. 

• Nilpotent Orbits In fliJ(V) for D — C 
and Nondegenerate Skew-symmetric ^ 

Let m, be a skew-symmetric partition of n. Let 'I'm be the sl 2 (R)-invariant 
form on Vm such that for all d, 

T I [ ® ^d* if is even, 

d'mld = { d 

if d is odd. 

Then d 'm is equivalent to <P. Consider the GLf,(V)-conjugacy class of sl 2 (R)- 
subalgebras in gtf)(G) corresponding under * to the s [ 2 (R)-equi valency class 
of d'm- Then by (F1)-(F3), [KR], the union of all sl 2 (K)-subalgebras from 
this class contains a unique nilpotent GLf,(V)-orbit Om- 
Ad(g[f,(V))-orbits in A/'(g[|,(K)): 

Om is an Ad(g[f,(V))-orbit. Such Ad(g[f,(K))-orbits, taken over 
all skew-symmetric partitions m of n, are pairwise different and 
exhaust all nonzero Ad(glf,(V))-orbits in Af(gl%(V)). 

Orbit dimensions: 

dime Om = ~ Ed d^^d ~ Ed odd ^d) /2. 

• Nilpotent Orbits In 0l%(V) for D — C 
and Nondegenerate Hermitian # 

Let m be a fine partition of n associated with (19). Let d 'm be the sl 2 (R)- 
invariant form on Vm such that for all d, 

^rn\d = O (26) 

Then 'I'm is equivalent to if and only if (24) holds. In the last case, consider 
the GLf,(V)-conjugacy class of s[ 2 (K)-subalgebras in glf)(K) corresponding 
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under * to the sl 2 (R)-equivalency class of 'Pjn- Then by (F1)-(F3), [KR], the 
union of all sl 2 (M)-subalgebras from this class contains a unique nilpotent 
GL|,(V)-orbit Orn. 

Ad(g[f,(R))-orbits in A/'(g[f,(R)): 

If (24) holds, Orn is an Ad(g(|,(V)) -orbit. Such Ad(glf,(V))- 
orbits, taken over all fine partitions m of n satisfying (24), are 
pairwise different and exhaust all nonzero Ad (g(f,(R)) -orbits in 

Orbit dimensions: 



dimjj Om = ~Y.d <Pmd- 



• Nilpotent Orbits In Qi%{V) for ID = H 
and Nondegenerate Hermitian # 



Let m be a fine Hermitian partition of n associated with (19). Let 'I'rn be the 
sl 2 (IR)-invariant form on Vm such that for all d, 



0^ (g) if d is even, 

if c? is odd. 



(27) 



Then 'I'm is equivalent to if and only if (24) holds. In the last case, consider 
the GLf,(V)-conjugacy class of sl 2 (K)-subalgebras in glf)(R) corresponding 
under * to the sl 2 (R)-equivalency class of 'Pm- Then by (F1)-(F3), [KR], the 
union of all sl 2 (M)-subalgebras from this class contains a unique nilpotent 
GL|,(V)-orbit Om- 

Ad(g[f,(V))-orbits in A/'(g[f,(K)): 

If (24) holds, Om is an Ad(glS(K)) -orbit. Such Ad(glS(K))- 
orbits, taken over all fine Hermitian partitions m of n satisfying 
(24), are pairwise different and exhaust all nonzero Ad(glf,(K))- 
orbits in A/’(g[f,(K)). 

Orbit dimensions: 



dimjj Om = 2v? + n - 2Y,d ~ J2d odd ~^d- 



• Nilpotent Orbits In qI%{V) for ID = H and Skew-Hermitian # 



Let m be a fine skew-Hermitian partition of n associated with (19). Let 'Pm 
be the sl 2 (R)-invariant form on Vm such that for all d, 






QsH 
^ rud 






'Pm\d = 



if d is even, 
if d is odd. 



(28) 
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Then 'I'ra is equivalent to Consider the GLf,(V)-conjugacy class of sl 2 (R)- 
subalgebras in q\%{V) corresponding under * to the s [ 2 (R)-equi valency class 
of Ifm- Then by (F1)-(F3), [KR], the union of all sl 2 (R)-subalgebras from 
this class contains a unique nilpotent GLf,(V)-orbit Om- 

Ad(g[|,(V))-orbits in A/'(0[f,(G)): 

Om is an Ad(g[f,(V))-orbit. Such Ad(g[f,(G))-orbits, taken over 
all fine skew-Hermitian partitions rn of n, are pairwise different 
and exhaust all Ad(g[f,(V))-orbits in A/’(glf)(G)). 

Orbit dimensions: 

dimjj Om = 2n^ - n - 2 <Pmd + Ed odd ^d- 

Now we are ready to classify compact nilpotent elements in the real forms 
of complex classical Lie algebras. Recall that n = dim^ V. 



• Compact Nilpotent Elements In sin(K) and sl„(EI) 

Theorem 8. Let O be the Ad{5lD{V)) -orbit of a nonzero element x G 
Af(s[£)(R)) where D isM. or H. Let a be an sl 2 (S.) -subalgebra of sin (V) con- 
taining X. The following properties are equivalent: 

(i) X is compact. 

(ii) a-module V is simple. 

(iii) Lf D = R, then O = C(o,...,o,i) for odd n, and O^^ q or O^g p 
for even n. If D = H, then O = C(o,....o,i) • 

Proof. According to the previous discussion, we may, and will, assume that 
V = Vm and a = arn,(s[ 2 (R)) (see (22)) for some nontrivial partition m of 
n. The Double Centralizer Theorem implies that 

]>sio{v){o) = Q^oiTrud)- (29) 

Since (resp., s[D{Tmd)) is compact if and only if md = 0 (resp., 0 

or 1), the claim follows from (29) and (F5). □ 



• Compact Nilpotent Elements In S0n-q,q 

Theorem 9. Let O be the Ad{Ql^(V)) -orbit of a nonzero element x G 
A/”(glR(E)) for a nondegenerate symmetric form <L. The following properties 
are equivalent: 

(i) X is compact. 

(ii) O = Om or Om, where mis a fine symmetric partition ofn such that 
(24) holds, Pdqd = 0 for all odd d, and md = 0 for all even d. 
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Proof. We may, and will, assume that V = Vm, ^ is 'I'm defined by (23), and 
X G a := arn(sl2(R)) for some fine symmetric partition m of n such that (24) 
holds. Then (29) holds, whence by (23) 



3,tJ(v)(a) = where 0. = ^ (30) 

Since for 0d given by (30) is compact if and only if pdqd = 0 for 

odd d and nid = 0 for even d (see Table 1 and (18)), the claim follows from 
(30) and (F5). □ 

• Compact Nilpotent Elements In sp„(]R) 

Theorem 10. Let O be the Ad( 0 lR(E))-or 6 zt of a nonzero element x € 
Af( 0 lR(fo)) for a nondegenerate skew- symmetric form <1. The following prop- 
erties are equivalent: 

(i) X is compact. 

(ii) O = Ora where m is a fine skew- symmetric partition of n such that 
Pdqd = 0 for all even d, and md = 0 for all odd d. 

Proof. The arguments are similar to that in the proof of Theorem 9 with (23) 
replaced with (25). □ 



• Compact Nilpotent Elements In sUn—q,q 

Theorem 11. Let O he the Ad{Qlc(V))- orbit of a nonzero element x G 
■^(flic(fo)) ® nondegenerate Hermitian form <P. The following properties 
are equivalent: 

(i) X is compact. 

(ii) O = Oja where m is a fine partition of n such that (24) holds and 
Pdqd = 0 for all d. 

Proof. By Table 1, the algebra for 'P = 0^^^^ and W = T^^ is 

compact if and only if pdqd = 0. Now one completes the proof using the 
arguments similar to that in the proof of Theorem 9 with (23) replaced with 
(26). □ 

• Compact Nilpotent Elements In s|>„/ 2 -q,q 

Theorem 12. Let O be the Ad{gl^(y))- orbit of a nonzero element x G 
A/’(01h(C)) for a nondegenerate Hermitian form T>. The following properties 
are equivalent: 

(i) X is compact. 
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(ii) O = Om where m is a fine Hermitian partition of n such that (24) 
holds, pdQd = 0 for all odd d, and rrid = 0 or 1 for all even d. 

Proof. It follows from Table 1 and (18) that the algebra Q^iW) for !?' = 

(resp., 6>^) and W = is compact if and only if pdQd = 0 (resp., md = 0 
or 1). Now one completes the proof using the arguments similar to that in the 
proof of Theorem 9 with (23) replaced with (27). □ 



• Compact Nilpotent Elements In u* (H) 

Theorem 13. Let O be the Ad(0lg(E)) -or&zt of a nonzero element x € 
A/”(01h(E)) for a nondegenerate skew- Hermitian form L>. The following prop- 
erties are equivalent: 

(i) X is compact. 

(ii) O = Om where m is a fine skew- Hermitian partition of n such that 
PdQd = 0 for all even d, and md = 0 or 1 for all odd d. 

Proof. The arguments are similar to that in the proof of Theorem 12 with 
(27) replaced with (28). □ 



5 Classification For Exceptional Simple g 

In this section, we assume that g is an exceptional simple complex Lie algebra 
and 0JJ is its noncompact real form. According to E. Cartan’s classification 
(cf., e.g., [OV]), up to isomorphism there are, in total, twelve possibilities listed 
below in Table 5. Its second column gives both types of E. Cartan’s notation 
for the notation means that is the type of g and t is the signature 
of the Killing form of g^, i.e., t = dim^ p — dim^. t. 

Recall the classical approach to classifying nilpotent orbits by means of 
their characteristics and weighted Dynkin diagrams, cf. [CM], [Mj. Fix a In- 
stable Cartan subalgebra t of g such that t C £ is a Cartan subalgebra of £. 
Denote 

n:=dimct, s := dimc(t C £). 

Let p and Z\p be the root systems of resp. (g, t) and (£, tC £). Given 
a nonzero element e G Af(g) (resp., e G A/"(p)), there are the elements /i, / G g 
(resp., /i G £, / G p) such that {e,h,f} is an sl2-triple. The intersection of t 
(resp., tn£) with the orbit O = G-e (resp., K-e) contains a unique element ho 
lying in a fixed Weyl chamber of (resp., Z\p jp,f)). The mapping O ^ ho 

is a well defined injection of the set of all nonzero G-orbits in A/"(g) (resp., 
K-orbits in Af(p)) into t (resp., tC £). The image ho of the orbit O under 
this injection is called the characteristic of O (and e). Thus the G-orbits in 
A/”(g) (resp., K-orbits in A/”(p)) are defined by their characteristics. In turn, 
the characteristics are defined by the numerical data, namely, the system of 
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Table 5. 



0 


0K 


type of £r 


dim^ £ 


dimcp 


Ee 


EI=Eg(6) 


Sp4 


36 


42 


Ee 


EII=E6(2) 


SU2 © sue 


38 


40 


Ee 


EIII=Ee(_i4) 


soio © M 


46 


32 


Ee 


EIV=Eg(_26) 


F4(-52) 


52 


26 


Et 


EV=E7(7) 


SU8 


63 


70 


Et 


EVI=E7(_5) 


SU2 © SO 12 


69 


64 


Et 


EVII=E7(_25) 


Ee(-78) © ® 


79 


54 


Eg 


EVIII=E8(8) 


SO 16 


120 


128 


Eg 


EIX=Eg(_24) 


SU2 © E7(_i33) 


136 


112 


F 4 


1— 1 


SU2 © Sp3 


24 


28 


F 4 


FII— F4(_20) 


SO 9 


36 


16 


G 2 


GI=G2(2) 


SO 3 © SO 3 


6 


8 



values {Pj{ho)} where {Pj} is a fixed basis of t* (resp., (tn t)*). In practice, 
{Pj} is always chosen to be a base of some root system. Then assigning the 
integer Pj{ho) to each node Pj of the Dynkin diagram of this base yields 
the weighted Dynkin diagram of the orbit O, denoted by DynO. It uniquely 
defines O. This choice of the base {Pj} is the following. 

For t*, since g is semisimple, it is natural to take {Pj} to be the base 
oi, . . . , a; of defining the fixed Weyl chamber that is used in the defi- 

nition of characteristics. Below the Dynkin diagrams of G-orbits in Af(g) are 
considered with respect to this base a\, . . . ,ai. 

To describe {Pj} for (tn t)*, denote by «o the lowest root of ^(g j)- The 
extended Dynkin diagrams of indicating the location of the a^’s are 

given in Table 6 . 

The real form gjj of g is of inner type (i.e., s = I, t C 6, and thereby 
^(e,int) C ^(0,t)) if and only if g^ ^ £0(6), E6(_26)- If 0 r is of inner type, then 
t is semisimple if and only if gjj yf E6(-i4); E7(_2s); in the last two cases the 
center of £ is one-dimensional. If g^ is of inner type, then the set {ao, . . . , ai} 
contains a unique base Pi, . . . ,Pr of Moreover, oq is one of the PPs 

4 =^ £ is semisimple 4 =^ r = /. If g^ is of inner type and £ is not semisimple, 
then r = I — \ and Pj G {ai, . . . , a;} for all j = 1, . . . , r; in this case we set 

Pi ■■= ai. 

Thus in all cases where gjj is of inner type, we have a basis {Pj} of (tn £)* 
that is the system of simple roots of some root system. The location of the 
Pj's is given in Table 6 . 

If gg is of outer type, then £ is semisimple, so we may, and will, take {Pj} 
to be a base of We take the following base. If gjj = Eg(_26), then 

Pi = ailtne = aeltne, Pz = asitne = Q^sltne, P 2 = 0!4|tnej Pi = « 2 |int, 
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tto a, tt2 a, 

ttg a, tt2 tta 04 



a, Oj 04 Oj Og 

02 O 



a, Og (I4 Og Og 




with the Dynkin diagram 

and if = £@( 6 ) , then 

(3i = —2^2 — 3/?3 — 2/?4 — o;2|tn{j 
/?2 = ailint = aeline) /3a = aalint = asline, /?4 = a4|tn{ 

with the Dynkin diagram 

Below the weighted Dynkin diagrams of _?f-orbits in A/”(g) are considered 
with respect to the described base {Pj}- 
In [D3], [D4] one finds: 

(Dl) the weighted Dynkin diagrams of all nonzero orbits G ■ x and K ■ x for 
a;GA/'(p), 

(D2) the type and dimension of the reductive Levi factor of 3 {(a:) and 
dimc3{(a;), 

(D3) the type of the reductive Levi factor of 30 ^( 2 /) for an element y of the 
Ad( 0 ]j)-orbit in Af(g^) corresponding to AT -a; via the Kostant-Sekiguchi 
bijection. 

Given the weighted Dynkin diagram of G-x, one finds the type of reductive 
Levi factor of 30 (x) in [El], [Caj. So using (Dl), one can apply Theorem 4 for 
explicit classifying (— l)-distinguished AT-orbits in A/”(p). On the other hand, 
given (D3), Theorem 5 can be applied for this purpose as well. So following 
either of these ways, one obtains, for every exceptional simple g, the explicit 
classification of (— l)-distinguished iL-orbits in Af{p) in terms of their weighted 
Dynkin diagrams. The final result is the following. 
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Theorem 14. For all exceptional simple Lie algebras g and all conjugacy 
classes of elements 0 € Autg of order 2, all {—!)- distinguished K -orbits in 
Af{p) are listed in Tables 7-18 at the end of this paper. 

Tables 7-18 contain further information as summarized below. 

(Tl) The conjugacy class of 0 is defined by specifying the type of noncompact 
real form gjj of g canonically corresponding to this class. 

(T2) Column 2 gives the weights {Pj{h)} (listed in the order of increasing of 
j) of the weighted Dynkin diagram DynK • x of the (— l)-distinguished 
AT-orbit K ■ x in M{p), where h is the characteristic of K ■ x. 

(T3) Column 3 gives the weights {aj{H)} (listed in the order of increasing 
of j) of the weighted Dynkin diagram Dyn G ■ x of the G-orbit G ■ x in 
A/"(g), where H is the characteristic of G • cc. 

(T4) Column 4 gives dimj;. K ■ x, and hence, by (2), also dimj;. G • x. 

(T5) Column 5 gives the number of ifT-orbits (not necessarily (— l)-distin- 
guished) in G ■ xfip. One of them is K ■ x. Since this number is equal to 
the number of 7f-orbits K ■ x' in N{p) such that Dyn G ■ x' = Dyn G • x, 
one finds it using the tables in [D3], [D4]. 

(T6) Columns 6 gives the type of the reductive Levi factor of 3 e(a;). By 
is denoted the Lie algebra of an m-dimensional torus. 

(T7) Column 7 gives the complex dimension of the unipotent radical of 3 ((x). 



Remark 1. For £ 5 ( 6 ) and E 6 (_ 26 )j our numeration of {aj} is the same as in 
[D3]; it differs from that in [D4]. For Eg(_ 26 ), our numeration of {fij} differs 
from that in [D3]. 

Remark 2. One finds in [D5], [D6], [D7] the explicit classification of all Cayley 
triples in g. This yields the explicit representatives of all iF-orbits in Af(p) 
and Ad(gjj)-orbits in N{q^). 



6 Geometric Properties 

Geometric properties of the varieties P(G) where G is a nilpotent iF-orbit 
in Af{p) have been studies by several authors. Thereby their results provide 
some information on the geometry of the projective self-dual varieties that 
we associated with symmetric spaces. However these results are less complete 
than in the adjoint case (where a rather detailed information about singular 
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loci and normality of the projective self-dual varieties P(0) is available, see 
[P2]). Some phenomena valid for the projective self-dual P(0)’s in the adjoint 
case fail in general. Below we briefly summarize some facts about the geometry 
of the projective self-dual varieties that we associated with symmetric spaces. 

Intersections of G-orbits In P(A/"(g)) 

With the Linear Subspace P(l>) 

Let G be a nonzero G-orbit in Af{g), and X = P(G). If X n P(p) yf 0, 
then, by (2), all irreducible components Yi,...Ys of the variety X n P(p) 
have dimension | dim Jf, and every Yj is the closure of a AT-orbit in P(Af(p)). 
Theorems 2, 3 and Definition 1 imply that 

X is self-dual all Yi, ... ,Yg are self-dual. 

There are many examples showing that the converse in not true. For instance, 
one deduces from Table 8 that g = Ee, gR = Eg( 2 ) and DynG = 111011, 121011 
or 220202 are such cases. There are also many examples where some of the Yj’s 
are self-dual and some are not: for instance, this is so if g = Ee, gR = Eg( 2 ) and 
DynG = 020000,001010,000200,020200 or 220002. Finally, there are many 
instances where all Yj are not self-dual (to obtain them, e.g., compare Tables 
7-18 with tables in [D3], [D4]). 

AfRne (— l)-distinguished Orbits 

Recall that by Matsushima’s criterion, an orbit of a reductive algebraic group 
acting on an affine algebraic variety is affine if and only if the stabilizer of 
a point of this orbit is reductive, c£, e.g. [PV, Theorem 4.17]. Therefore dis- 
tinguished G-orbits in A/”(g) are never affine. However in general there exist 
affine (— l)-distinguished RT-orbits in JV{p). For instance, if g is exceptional 
simple, we immediately obtain their classification from Tables 7-18: these are 
precisely the orbits for which the number in the last column is 0. 

If K-x is affine, then each irreducible component of the boundary P(K • x)\ 
P{K-x) has codimension 1 in P{K ■ x), cf. [PI, Lemma 3]. Therefore if a point 
of the open iF-orbit of such an irreducible component lies in the singular locus 
of P{K ■ x), then P{K ■ x) is not normal. 

Orbit Closure Ordering and Orbit Decomposition 
Of the Orbit Boundary P{K • x) \ P{K • x) 

The closure ordering on the set of TF-orbits in A/’(p) (resp., Ad(gjg)-orbits in 
A/’(g]j)) is defined by the condition that 0\ > Oi if and only if O 2 is contained 
in the closure of 0\ and 0\ yf 02- According to [BS], the Kostant-Sekiguchi 
bijection preserves the closure ordering. Clearly its describing can be reduced 
to the case of simple g. In this case, the explicit description of the closure 
ordering is obtained in [Dl], [D2], [D8], [D9], [DIO], [Dll], [D12], [D13] (see 
also [O], [Se]). 
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This information and Theorems 8-14 yield the orbit decomposition of ev- 
ery irreducible component of the orbit boundary P(K ■ x) \ P(K • x) for any 
(— l)-distinguished AT-orbit K ■ x. In particular, this gives the dimensions of 
these components and their intersection configurations. 



Singular Locus Of a Self-dual Variety P(1T • x) 

Apart from a rather detailed information on the singular loci of the self-dual 
projectivized nilpotent orbit closures in the adjoint case (see [P2]), in general 
case only a partial information is available. In [O], for (g, t) = (sl„(C), so„(C)) 
and (sl 2 n(C),sp„(C)), the normality of the nilpotent orbit closures K-x 
(hence that of P{K ■ x)) is studied. In particular, it is shown there that 
for (g, £) = (sl 2 n(C),sp„(C)), normality holds for any K ■ x, but if (g,6) = 
(sl„(C),so„(C)), this is not the case. See also [Se], [O], [SeSh], where the local 
equations of the generic singularities of some orbit closures in P(Af(p)) are 
found. By [P3, Proposition 4], Hesselink’s desingularization of the closures of 
Hesselink strata, [He], cf. [PV], yields a desingularization of any orbit closure 
P{K ■ x) in P(A/’(p)) (in [R], another approach to desingularization of such 
orbit closured is considered). 



Table 7 . (— l)-distinguished A-orbits K ■ x m N{p) for gu = Eg(g) 



No. 


DynA • x 


Dyn G ■ X 


dimj; A • X 


UG-xnp)/K 


it{x)/va.Auit{x) 


dimcrad„3e(a:) 


1 


2222 


202222 


35 


1 


0 


1 


2 


2202 


220002 


33 


2 


0 


3 


3 


0220 


220002 


33 


2 


0 


3 


4 


4224 


222222 


36 


1 


0 


0 



Table 8. (— l)-distinguished A-orbits A • a; in A/”(p) for = Ee( 2 ) 



No. 


DynA • x 


Dyn G ■ x 


dime A • X 


tt(G-a;np)/A 


lt{x)/va.Auit{x) 


dimcrad„3e(a:) 


1 


000004 


020000 


21 


3 


2 A 2 


1 


2 


301000 


001010 


25 


3 


Ai -PTi 


9 


3 


001030 


001010 


25 


3 


Ai -PTi 


9 


4 


004000 


000200 


29 


3 


T 2 


7 


5 


020204 


000200 


29 


3 


T 2 


7 


6 


004008 


020200 


30 


2 


A 2 


0 


7 


400044 


220002 


30 


2 


Ai -PTi 


4 


8 


121131 


111011 


31 


2 


Ti 


6 


9 


311211 


111011 


31 


2 


Ti 


6 


10 


313104 


121011 


32 


2 


Ti 


5 


11 


013134 


121011 


32 


2 


Ti 


5 
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Table 8. (continued) (— l)-distinguished A-orbits K ■ x in M(p) for = Ee( 2 ) 



No. 


DynJf • X 


Dyn G ■ X 


dime ^ ® 


UG-xnp)/K 


it(x)/c&Auii{x) 


dimcrad„3e(x) 


12 


222222 


200202 


33 


2 


0 


5 


13 


040404 


200202 


33 


2 


0 


5 


14 


224224 


220202 


34 


2 


Ti 


3 


15 


404048 


220202 


34 


2 


Ti 


3 


16 


440444 


222022 


35 


1 


0 


3 


17 


444448 


222222 


36 


1 


0 


2 



Table 9. (— l)-distinguished A-orbits K ■ x in A/”(p) for gj{ = Eg(_ 26 ) 



No. 


DynJf • X 


Dyn G ■ X 


dime ^ ® 


i(G-xnp)/K 


lt(x)/ra.Auit(x) 


dimcrad„3e(a:) 


1 


0001 


100001 


16 


1 


Bs 


15 


2 


0002 


200002 


24 


1 


G2 


14 



Table 10. (— l)-distinguished A-orbits A • a: in A/”(p) for gg = E 6 (_i 4 ) 



No. 


Dyn A • x 


Dyn G ■ X 


dime ^ ' x 


UG-xnp)/K 


it(x)/va.Ault(x) 


dime rad„3t(a:) 


1 


100001 


100001 


16 


3 


Bs + Ti 


8 


2 


10000-2 


100001 


16 


3 


Bs + Ti 


8 


3 


10101-2 


110001 


23 


2 


h.2 + Tl 


14 


4 


11100-3 


110001 


23 


2 


A 2 + Ti 


14 


5 


40000-2 


200002 


24 


1 


G 2 


8 


6 


03001-2 


120001 


26 


2 


B 2 + Tl 


9 


7 


01003-6 


120001 


26 


2 


B 2 + Tl 


9 


8 


02202-6 


220002 


30 


1 


Ai +Ti 


12 



Table 11. (— l)-distinguished A-orbits K ■ x in A/”(p) for g^ = f- 7 (- 5 ) 



No. 


DynJf • X 


Dyn G ■ X 


dime ^ ' x 


UG-xnp)/K 


ii{x)/c&Auii(x) 


dimcrad„3e(a:) 


1 


0000004 


2000000 


33 


3 


As 


1 


2 


4000000 


0000020 


42 


2 


G 2 +Ai 


10 


3 


0000400 


0020000 


47 


3 


3Ai 


13 


4 


0002004 


0020000 


47 


3 


3Ai 


13 


5 


0000408 


2020000 


48 


2 


C 3 


0 


6 


2010112 


0001010 


49 


1 


Ai+Ti 


16 


7 


0400004 


2000020 


50 


2 


A 2 + Tl 


10 


8 


1111101 


1001010 


52 


1 


T 2 


15 


9 


2010314 


2001010 


53 


1 


Ai +Ti 


12 
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Table 11. { continued ) (— l)-distinguished Jl-orbits K ■ x in A/”(p) for = E7(_5) 



No. 


DynK ■ x 


Dyn G ■ X 


dimj; K ■ X 


tt(G-a:np)/7f 


ii { x ) / x & duii { x ) 


dimcrad„3e(a:) 


10 


0040000 


0002000 


53 


1 


Ai 


13 


11 


0202202 


0020020 


55 


2 


Ai 


11 


12 


0004004 


0020020 


55 


2 


Ai 


11 


13 


0202404 


2020020 


56 


2 


2Ai 


7 


14 


0400408 


2020020 


56 


2 


2Ai 


7 


15 


4004000 


0002020 


57 


1 


Ai 


9 


16 


0404004 


2002020 


59 


1 


Ti 


9 


17 


0404408 


2022020 


60 


1 


Ai 


6 




Table 12 . (— l)-distinguished Tf-orbits K • 


x in A/"(p) for g* = £7(7) 


No. 


T)jnK ■ X 


Dyn G ■ X 


dime K ® 


< i { G - xr\^)/K 


it { x ) / T & duii { x ) 


dimcrad„3e(a:) 


1 


4000000 


0200000 


42 


4 


G2 


7 


2 


0000004 


0200000 


42 


4 


G2 


7 


3 


0040000 


0000200 


50 


4 


Ai 


10 


4 


0000400 


0000200 


50 


4 


Ai 


10 


5 


3101021 


1001010 


52 


3 


T2 


9 


6 


1201013 


1001010 


52 


3 


T2 


9 


7 


4004000 


2000200 


54 


4 


Ai 


6 


8 


0004004 


2000200 


54 


4 


Ai 


6 


9 


2220202 


0002002 


56 


4 


0 


7 


10 


2020222 


0002002 


56 


4 


0 


7 


11 


0400400 


0002002 


56 


4 


0 


7 


12 


0040040 


0002002 


56 


4 


0 


7 


13 


2222202 


2002002 


58 


4 


0 


5 


14 


2022222 


2002002 


58 


4 


0 


5 


15 


4004040 


2002002 


58 


4 


0 


5 


16 


0404004 


2002002 


58 


4 


0 


5 


17 


4220224 


2002020 


59 


2 


Ti 


3 


18 


2422222 


2002022 


60 


4 


0 


3 


19 


2222242 


2002022 


60 


4 


0 


3 


20 


4404040 


2002022 


60 


4 


0 


3 


21 


0404044 


2002022 


60 


4 


0 


3 


22 


4404404 


2220202 


61 


2 


0 


2 


23 


4044044 


2220202 


61 


2 


0 


2 


24 


4444044 


2220222 


62 


2 


0 


1 


25 


4404444 


2220222 


62 


2 


0 


1 


26 


8444444 


2222222 


63 


2 


0 


0 


27 


4444448 


2222222 


63 


2 


0 


0 
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Table 13. (— l)-distinguished A-orbits K ■ x In N{p) for gj. = Ey(_ 25 ) 



No. 


DynA • x 


Dyn G ■ X 


dimj; K ■ X 


i{G-xnp)/K 


3e(a;)/radu^e(a:) 


dime rad„ 3 e(a;) 


1 


0000002 


0000002 


27 


4 


F4 


0 


2 


000000-2 


0000002 


27 


4 


F4 


0 


3 


010010-2 


1000010 


38 


2 


As + Ti 


25 


4 


011000-3 


1000010 


38 


2 


As + Ti 


25 


5 


200002-2 


2000002 


43 


4 


Bs 


15 


6 


400000-2 


2000002 


43 


4 


Bs 


15 


7 


000004-6 


2000002 


43 


4 


Bs 


15 


8 


200002-6 


2000002 


43 


4 


Bs 


15 


9 


220002-6 


2000020 


50 


1 


A 2 + Ti 


20 


10 


400004-6 


2000022 


51 


2 


G 2 


14 


11 


400004-10 


2000022 


51 


2 


G 2 


14 



Table 14. (— l)-distinguished A-orbits K ■ x in A/”(p) for gu = Es(8) 



No. 


Dyn A • x 


Dyn G ■ X 


dime ^ ® 


tt(G-*np)/A 


it{x)lr&Ault{x) 


dimcrad„3e(a:) 


1 


40000000 


20000000 


78 


3 


2 G 2 


14 


2 


00000004 


02000000 


92 


3 


A 2 


20 


3 


21010100 


00010001 


96 


3 


Ai +Ti 


20 


4 


00400000 


00000200 


97 


2 


2Ai 


17 


5 


40000040 


02000002 


99 


3 


A 2 


13 


6 


20200200 


00002000 


104 


3 


0 


16 


7 


00004000 


00002000 


104 


3 


0 


16 


8 


02002002 


00002000 


104 


3 


0 


16 


9 


40040000 


20000200 


105 


2 


2Ai 


9 


10 


02002022 


00002002 


107 


3 


Ti 


12 


11 


00400040 


00002002 


107 


3 


Ti 


12 


12 


31010211 


10010101 


108 


2 


Ti 


11 


13 


13111101 


10010102 


109 


2 


Ti 


10 


14 


20202022 


00020002 


no 


2 


0 


10 


15 


04004000 


00020002 


no 


2 


0 


10 


16 


02022022 


20002002 


111 


3 


Ti 


8 


17 


40040040 


20002002 


111 


3 


Ti 


8 


18 


00400400 


00020020 


112 


2 


0 


8 


19 


22202022 


00020020 


112 


2 


0 


8 


20 


22202042 


00020022 


113 


2 


0 


7 


21 


04004040 


00020022 


113 


2 


0 


7 


22 


22222022 


20020020 


114 


2 


0 


6 


23 


40040400 


20020020 


114 


2 


0 


6 
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Table 14. {continued) (—1) -distinguished if-orbits K ■ x in Af{p) for = Egjg) 



No 


DynJf • X 


Dyn G ■ X dimj; K 


xKG 


X n p)/K 


ii{x) /x&Auii{x) dime 


rad„3e(x) 


24 


22222042 


20020022 


115 




2 


0 


5 


25 


04040044 


20020022 


115 




2 


0 


5 


26 


22222222 


20020202 


116 




2 


0 


4 


27 


44040400 


20020202 


116 




2 


0 


4 


28 


24222242 


20020222 


117 




2 


0 


3 


29 


44040440 


20020222 


117 




2 


0 


3 


30 


44044044 


22202022 


118 




1 


0 


2 


31 


44440444 


22202222 


119 




1 


0 


1 


32 


84444444 


22222222 


120 




1 


0 


0 




Table 15. (— l)-distinguished A'-orbits K ■ x in A/”(p) for gg = Eg( 


-24) 


No 


DynJf • X 


Dyn G ■ X dime ^ 


xKG 


X n p)/K 


it{x) /x&Auii{x) dime 


x&Auit{x) 


1 


00000004 


00000002 


57 




3 


Eg 


1 


2 


00000204 


00000020 


83 




3 


D4 


25 


3 


00000040 


00000020 


83 




3 


D4 


25 


4 


00000048 


00000022 


84 




2 


F4 


0 


5 


01100012 


10000100 


89 




1 


B 2 + Ti 


36 


6 


40000004 


20000002 


90 




2 


A 4 


22 


7 


10100111 


10000101 


94 




1 


A 2 -I- Ti 


33 


8 


01100034 


10000102 


95 




1 


As 


26 


9 


00020000 


00000200 


97 




1 


2Ai 


33 


10 


20000222 


20000020 


99 




2 


G 2 


23 


11 


00000404 


20000020 


99 




2 


G 2 


23 


12 


20000244 


20000022 


100 




2 


Bg 


15 


13 


40000048 


20000022 


100 




2 


Bg 


15 


14 


00020200 


20000200 


105 




1 


2Ai 


25 


15 


40000404 


20000202 


107 




1 


A 2 


21 


16 


40000448 


20000222 


108 




1 


G 2 


14 
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Table 16. (— l)-distinguished A-orbits K ■ x in A/”(p) for = F’ 4 { 4 ) 



No. 


DynJf • X 


Dyn G ■ X 


dime ^ ® 


UG-xnp)/K 


it{x)/r&Auii{x) 


dimcrad„3e(x) 


1 


0004 


2000 


15 


3 


k.2 


1 


2 


0040 


0200 


20 


3 


0 


4 


3 


0204 


0200 


20 


3 


0 


4 


4 


2022 


0200 


20 


3 


0 


4 


5 


2200 


0048 


21 


2 


Ai 


0 


6 


0404 


0202 


22 


2 


0 


2 


7 


2222 


0202 


22 


2 


0 


2 


8 


2244 


2202 


23 


2 


0 


1 


9 


4048 


2202 


23 


2 


0 


1 


10 


4448 


2222 


24 


1 


0 


0 



Table 17. (— l)-distinguished A-orbits K ■ x in A/”(p) for = p 4 (_ 2 o) 



No. 


Dyn A • x 


Dyn G ■ x 


dime ^ ® 


tt(G-®np)/A 


it{x)/r&Auii{x) 


dimcrad„3e(a:) 


1 


0001 


0001 


11 


1 


As 


10 


2 


4000 


0002 


15 


1 


G 2 


7 



Table 18. (— l)-distinguished A-orbits K ■ x in A/”(p) for gu = 62 ( 2 ) 



No. 


Dyn A • x 


Dyn G ■ X 


dime ^ ® 


tt(G-*np)/A 


it{x)/r&Auit{x) 


dimcrad„3e(a:) 


1 


22 


02 


5 


2 


0 


1 


2 


04 


02 


5 


2 


0 


1 


3 


48 


22 


6 


1 


0 


0 
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The Role Of Exotic Affine Spaces 
In the Classification 
Of Homogeneous Affine Varieties 



Dennis Snow* 

Department of Mathematics, University of Notre Dame, Notre Dame, IN 
46556-4618, USA. snow.l@nd.edu 

Let G be a connected linear algebraic group over C and let H a closed algebraic 
subgroup. A fundamental problem in the study of homogeneous spaces is to 
describe, characterize, or classify those quotients G/H that are afSne varieties. 
While cohomological characterizations of affine G/H are possible, there is still 
no general group-theoretic conditions that imply G/H is affine. In this article, 
we survey some of the known results about this problem and suggest a way of 
classifying affine G/H by means of its internal geometric structure as a fiber 
bundle. 

Cohomological characterizations of affine G/H provide useful vanishing 
theorems and related information if one already knows G/H is affine. Such 
characterizations cannot be realistically applied to prove that a given homo- 
geneous space G/H is affine. Ideally, one would like to have easily verified 
group-theoretic conditions on G and H that imply G/H is affine. Very few 
positive results are known in this direction, the most notable of which is Mat- 
sushima’s Theorem for reductive groups. For general linear algebraic groups 
there is a natural generalization of Matsushima’s Theorem that provides a 
necessary condition for G/H to be affine. While this criterion is also sufficient 
for some special situations, it is not sufficient in general. 

In the absence of general group-theoretic conditions for G/H to be affine, 
it is worthwhile to understand the underlying geometric structure of an affine 
homogeneous space G/H . Such a space is always isomorphic to a fiber bundle 
over an orbit of a maximal reductive subgroup of G. The fiber is a smooth 
affine variety diffeomorphic to an affine space C". Here several interesting 
phenomena seem possible: either the fiber is truly an “exotic” affine space or 
is in fact isomorphic to C". If exotic structures occur, they would also provide 
counter-examples to the Cancellation Problem for affine spaces. So far, no 
such exotic examples are known. If such structures are impossible, then an 
affine homogeneous space G/H would always have the simple description of 
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a homogeneous vector bundle. In this case, one can change groups, G/H = 
G / H, where G and H are easily classified, giving an indirect group-theoretic 
characterization for G/H to be affine. 



1 Cohomological Characterizations 

Recall that a subgroup H G G is called observable if every finite dimensional 
rational i7-module can be embedded as an iJ-submodule of a finite dimen- 
sional rational G-module. This is equivalent to the condition that for any 
rational iJ-module V, the induced module V\ = {s : G ^ R | s{gh~^) = 
h ■ s{g)yh G H,yg G G} surjects onto V under the evaluation map s s(l). 
It is well-known that H is observable in G if and only if G/H is quasi-affine [2] . 
The subgroup H is call strongly observable if, given any rational H module V, 
V is an iJ-submodule of a rational G-module W such that = W'^ . Finally, 
H is called an exact subgroup of G if induction from rational iJ-modules to 
rational G-modules preserves short exact sequences. 

Theorem 1. [4, 13] The following are equivalent: 

1. G/H is affine. 

2. H is a strongly observable subgroup ofG. 

3. H is an exact subgroup of G. 

4. H^{Ru{H),0{G)) = 0 {or, equivalently, H^ {G / Ru{H) , O) = 0) where 
Ru{H) is the unipotent radical of H. 

Such characterizations of affineness are basically “cohomological” in na- 
ture. They are primarily used when one already knows that G/H is affine. 
Verifying the properties themselves may be more difficult than directly prov- 
ing that G/H is affine. 



2 Group-theoretic Conditions 

There is a practical need for easily verified conditions on the groups G and H 
that guarantee the quotient G/H is affine. We shall now investigate some of 
the known results in this direction. 

2.1 Unipotent and Solvable Groups 

If G is a unipotent linear algebraic group, then G/H = C" for any algebraic 
subgroup H. More generally, if G is a solvable linear algebraic group, then 
G/H = C" X (C*)™. The corresponding statements for complex Lie groups 
are not automatically true. For example if G = C* xC* and H = {(e^, e*^) | z € 
C}, then G/H is a compact complex torus. Nevertheless, some generalizations 
are possible, see [13]. 
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2.2 Reductive Groups 

After these relatively simple cases, the best known group-theoretic criterion 
for G/H to be affine goes back to Matsushima [8]: 

If G is reductive then G/H is affine if and only if H is reductive. 

Matsushima’s original theorem assumes G is a reductive complex Lie group 
and characterizes when G/H is Stein. However, a reductive complex Lie group 
G is in fact biholomorphically isomorphic to an algebraic group [6] and G/H is 
affine if it is Stein [1]. Matsushima’s theorem has been generalized to reductive 
algebraic groups over algebraically closed fields of positive characteristic, see 
[11, 3], 

2.3 General Linear Algebraic Groups 

Any connected linear algebraic group G has a decomposition into a semi-direct 
product, G = M ■ Ru{G), where M is a maximal reductive subgroup M and 
Ru{G) is the unipotent radical of G. A closed algebraic subgroup H has a sim- 
ilar decomposition, H = L ■ Ru{H) where L is a maximal reductive subgroup 
of H (not necessarily connected). Since the maximal reductive subgroups of 
G are conjugate, we may assume L C M. The group L is not important in 
determining whether G/H is affine: 

G/H is affine if and only ifG/Ru{H) is affine. 

This follows from the fact that L is reductive and G/Ru{H) G/H is a 
principal L-bundle, see [11]. We therefore focus our attention on Ru{H) and 
its location in G. 

If Ru{H) c Ru{G), then, of course, G/Ru{H) = M x Ru{G)/Ru{H) is 
affine and so G/H is affine. However, Ru{H) C Ru{G) is not a necessary 
condition for G/H to be affine. For example, let G be the semi-direct product 
SL(2, C) • U where U is the standard 2-dimensional representation of SL(2, C), 
and let 

Then G/iJ ^ SL(2,C) x C. 

A necessary condition for G/H to be affine is not hard to discover, see 
[4, 13]. 

Lemma 1. If G/H is affine then the intersection of Ru{H) with any reductive 
subgroup of G is trivial. 

Proof. Let M be a maximal reductive subgroup of G. We must show that 
Ru{H) n = 1 for all g € G. Since G/H affine, so is G/Ru{H), and thus 
any M-orbit of minimal dimension in G/i?„(iL), being automatically closed, 
is affine, see [10]. By Matsushima’s Theorem, the isotropy subgroup in M of 



x(0,t)]tGC}. 
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such an orbit is reductive. However, it also is of the form MDRu{H)^ for some 
g G G, and, being a subgroup of a the unipotent algebraic group is 

unipotent. Therefore, MnRu{H)^ = 1 and any M-orbit of minimal dimension 
is isomorphic to M. Hence, all M-orbits have the same dimension. Therefore 
every M orbit in G/G„(iJ) is isomorphic to M and M n = 1 for all 

gGG. □ 

The above lemma also holds when G/H is Stein [13]. Notice that the 
lemma is a natural generalization of Matsushima’s Theorem in one direction: 
if G is reductive and G/H is affine, then the lemma implies = 1 and 

H is reductive. It is natural to explore whether the converse to Lemma 1 
holds. For convenience, let us say that H satisfies Matsushima’s criterion in 
G if the intersection of with any reductive subgroup of G is trivial, or 

equivalently, if Ru{H) n = 1 for all gGG. 

If H satisfies Matsushima’s Criterion, then, as we have seen in the proof 
of the lemma, a maximal reductive subgroup M of G acts freely on G/Ru{H). 
It is easy to see that this condition is equivalent to Ru{H) acting freely on 
M\G from the right. Since M\G = i?„(G) = C", we are led to considering 
free actions of unipotent groups on affine space. In fact, in this situation, the 
actions are also triangular [14]. However, free unipotent triangular actions on 
C" can be badly behaved in general: the quotient may not be separated and 
may not be affine even if it is separated [15]. Nevertheless, this point of view 
does yield positive results in certain simple cases. 

Theorem 2. [4, 14] Let G be a linear algebraic group and let H be a closed 
subgroup. Assume that dim Ru{H) < 1 or dim i?„(G) < 3. Then G/H is affine 
if and only if H satisfies Matsushima’s criterion. 

Matsushima’s Criterion is not sufficient in general. The following example 
was discovered by Winklemann [15]: Let M = SL(6,C) and let 

G={ |0eC®,HGM}^MxC®. (1) 

Let 

1 

0 1 

0 0 1 

H = R^{H) = { 0 t si |s,tGC}. (2) 

0 0 t 0 1 

t t 0 0 0 1 

s + 0 0 0 t 1 

It is not hard to verify that H satisfies Matsushima’s Criterion, and that 
the quotient M\G/H exists and is a smooth contractible quasi-affine vari- 
ety. However, direct calculation with invariants shows that X = G/H is not 
affine. In fact, M\G/H is a smooth four-dimensional affine quadric with a 
2-codimensional subspace removed. 
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3 Geometric Description 



We now take a closer look at the underlying geometry of an affine homogeneous 
space G/H. As before, we let M be a maximal reductive subgroup of G and 
let L C M be a maximal reductive subgroup of H. Let U = Ru{G) and 
V = Ru{H) be the unipotent radicals of G and H, respectively. If G/H is 
affine, then we know by Lemma 1 that M acts freely on G/V and, equivalently, 
that V acts freely on M\G = U . Since G/V is affine and M is a reductive 
group acting freely, Hilbert’s theorem on invariants implies that the geometric 
quotient M\G/V is affine. In fact, the local description of G/V — > F in terms 
of “slices,” shows that the quotient map is a locally trivial principal bundle 
with fiber M, see [7, 12]. Consider the following diagram 



G 

M 

U 



G/V 

1 " 

Y 



where the vertical maps are the quotients by M and the horizontal maps are 
the quotients by V. Using local sections of G ^ F, we see that the fibration 
U ^ Y is also a locally trivial principal F-bundle. Thus, F is the base of 
a locally trivial fibration where both the total space U = C" and the fiber 
V = C™ are affine spaces. 

Proposition 1. If G/H is affine, then G/V is M -equivariantly isomorphic 
to M xY and U is V -equivariantly isomorphic toYxV. 

Proof. The principal U-bundle U ^ Y is topologically trivial because the 
structure group is contractible, and this immediately implies that the bundle 
is holomorphically trivial [5]. To see that it is also algebraically trivial, we pro- 
ceed by induction on dim V. If dim V = 1, then the triangular action of U onU 
is equivalent to a translation, see [4, 14] which implies U = F x U. If dim U > 1, 
then there is a normal subgroup Vi C V such that dimF/Vi = 1. The bundle 
G/V\ G/V with fiber V /V\ = C is trivial because H^{G/V,0) = 0. In 
particular, G/V\ is affine, and hence the quotient Fi = M\G/V\ exists and is 
affine. Since H^{Y,0) = 0, the principal U/Fi-bundle Fi ^ F is also trivial. 
By induction, U = Yi x V\, and therefore, U = Y x V /V\ x V\ = Y x V. 
Finally, composing a global section Y ^ U with the projection G ^ G/V 
gives a global section F ^ G/V, and this implies G/V is M-equivariantly 
isomorphic to M x Y. □ 



3.1 Cancellation Problem 

The Cancellation Problem is the following: if C" = F x C™, is F = C"”™? 
Since U = C" and V = C™, the isomorphism U = Y x V ot Proposition 1 
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gives an example of the Cancellation Problem. This problem remains unsolved 
in general, but has a positive answer if dim F < 2 [9] . 

Obviously, F is a smooth contractible affine variety. If dimF > 3, then F 
is in fact diffeomorphic to C"”™, [16]. If F is not algebraically isomorphic to 
Qn-m Y is called an exotic affine space. Exotic affine spaces are known 
to exist, although no examples are known in the context of the Cancellation 
Problem, [16]. The relative simplicity of the subgroup H in (2) leads one to 
believe that it may indeed be possible to create exotic affine spaces of the 
form F = M\G/V = U/V which would provide a negative answer to the 
Cancellation Problem at the same time. 

3.2 Homogeneous Bundle Structure 

The isomorphisms of Proposition 1 provide a natural bundle structure on an 
affine homogeneous space G/H. 

Theorem 3. Let L he a maximal reductive subgroup of H and let M he a 
maximal reductive subgroup of G containing L. If X = G/H is affine then X 
is isomorphic to a homogeneous bundle over M/L, X = M x^Y ^ M/L, 
with fiber Y a smooth contractible affine variety. 

Proof. The reductive group L acts by conjugation on both U = Ru{G) and 
V = Ru{H) and these actions are isomorphic to a linear representations. 
By Proposition 1, the F-equi variant isomorphism U = Y x V yields a F- 
equivariant map s : U ^ V satisfying s(uv) = s(u)v for all u G U, v € V. 

If we average s over a maximal compact subgroup H of L, 

s(u) = / k~^s{kuk~^)k dk, uGU 

Jk&K 

(where dk is some invariant measure on K), then s is still F-equi variant. More- 
over, since K is Zariski-dense in L, s{lul~^) = ls{u)l~^ for all I G L, u G U. 
If we identify F with the L-invariant subvariety s“^(l) C U, we obtain a 
natural action of T on F and the isomorphism U = Y x V is L-equi variant . 
Moreover, the right L action on G/V preserves the decomposition of Proposi- 
tion 1, G/V = M xY, so that G/H is isomorphic to the homogeneous bundle 
M XlY = M X Y/ ^ where (m,y) ~ {ml~^,l ■ y), for all m G M, y G Y, 
I G L. □ 

If the homogeneous bundle of Theorem 3 is a homogeneous vector bundle, 
then it is possible to “change” the groups G and H so that their maximal 
reductive subgroups and unipotent radicals are aligned. 

Theorem 4. Let X = G/H he affine and let X = M x^Y ^ M/L be 
the homogeneous bundle of Theorem 3. If Y is isomorphic to a linear repre- 
sentation of L, then there exist linear algebraic groups G = M ■ Ru{G) and 
H = L- Ru{H) such that G/H ^ G/H and Ru{H) C i?„(G). 
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Proof. By Theorem 1, the sections H^{M/L,X) = Y\^ generate the bundle. 
Therefore, there exists a finite dimensional M-submodule U C H^{M/L,X) 
that spans the vector space fiber Y over the identity coset zq G M/L. The 
semi-direct product G = M -U then acts on X = M x^Y hy (m, u) ■ [m', y] = 
[mm',y + u{m')] for all m,m' G M, y G Y, and u G U. (Recall that the 
section u is an L-equivariant map u \ M ^ Y , = lu{m) for all 

m G M , I G L.) This action is clearly transitive, because the sections U span 
Y over the identity coset zq G M/L. The isotropy subgroup of the point 
[1,0] G M XlY is easily computed to be the semi-direct product H = L ■ V 
where V = {u G U \ u{L) = 0}. □ 
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Abstract. We define and stndy several equivariant stratifications of the isotropy 
and coisotropy representations of a parabolic subgroup in a complex reductive group. 



0 Introduction 

Let G be a connected complex reductive algebraic group with a Levi subgroup 
L C P. Then the Lie algebra g of G admits a block decomposition g = Sx> 

where Z is the character group of the connected component Z of the center 
of L. We have go = I, the Lie algebra of L. If L = T is a maximal torus of G 
then a block decomposition is just a root decomposition. In this case the basic 
fact about semisimple Lie algebras is that any element e € g^^, X 7 ^ Oj can 
be embedded in a homogeneous sl 2 -triple (e,h,f), where / G g-x? G tR> 
where Ir is the canonical real form of a Cartan subalgebra t. In this paper we 
try to generalize this fact in the following direction. 

Let P C G be a proper parabolic subgroup with a Levi decomposition 
P = L- N, and P~ the opposite parabolic subgroup, so PC]P~ = L. Let p, n 
(the unipotent radical of p), p~ denote the corresponding Lie algebras. 

P is maximal if and only if Z-grading reduces to Z-grading of the form 
®i=-fcflo which case p = In general, Z admits a total ordering 

such that p = ®x>oflx> = ®x>oflx- shall also use the identification 
fl/P" = ®x>o 0x> which is an isomorphism of L-modules. 

Any element e G n (resp. e G g/p~) has the weight decomposition e = 
Ex>o ®x> where G gx- Each is a homogeneous nilpotent element of g, 
and therefore can be embedded (not uniquely) in a homogeneous sl 2 -triple 
(c;^, h^, fx), where G g-x; ^x ^ Here by an s( 2 -triple (e, /, h) we mean a 
collection of possibly zero vectors such that [e, /] = h, [h, e] = 2e, [h, f] = —2/. 
The collection of elements {h^} is called a multiple characteristic of e (or of 
the collection A compact real form of the Lie algebra of a reductive 

subgroup in G is, by definition, the Lie algebra of a compact real form of this 
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complex algebraic subgroup. We fix a compact real form 6 C 1. The multiple 
characteristic {h^^} is called Hermitian if any S H- 

In this paper we consider the following question: is it true that any e G n 
(resp. e G admits a Hermitian multiple characteristic up to P-conjugacy 

(resp. up to P“-conjugacy)? Clearly, we may (and shall) suppose that G is 
simple. We can identify parabolic subgroups with coloured Dynkin diagrams. 
Black vertices correspond to simple roots such that the corresponding root 
subspaces belong to the Levi part of the parabolic subgroup. The following 
theorem is the main result of this paper. 

Theorem 1. Suppose that G is simple and not E-j or E^, or G is equal to 
E-j or Es, but P is not of type 38-59 (see the Table at the end of this paper). 
Then for any e G n {resp. e G fl/p~) there exists p € P {resp. p G P~) such 
that Ad(p)e admits a Hermitian multiple characteristic. 

The proof involves many case-by-case considerations, and the open cases 
38-59 are too complicated to be analyzed using methods presented here. The 
adjoint case e G g/p~ and the coadjoint case e G n are studied separately. 

Theorem 1 has the following corollary valid over an arbitrary algebraically 
closed field k of characteristic 0. For any collection of elements wi, . . . ,u„ of 
an algebraic Lie algebra f) we denote by {vi, . . . , u„)aig the minimal algebraic 
Lie subalgebra of f) containing wi, . . . , 

Theorem 2. For the pairs {G,P) satisfying Theorem 1 over C, the following 
is true over k. For any e G n {resp. e G g/p^) there exists p G P {resp. p G P~) 
such that Ad(p)e admits a multiple characteristic {hy^} with reductive {h^f/aig- 

The following Theorem 3 (conjectured in [Te2]) was already proved in 
[Tel] for all parabolic subgroups that satisfy Theorem 2. Let denote the 
set of irreducible representations of G. For any V G 93g, there exists a unique 
maximal proper P-submodule My C V. Therefore, we have a linear map 
Tv ■ fl/p ^ Hom(My, V/My), Ty{x)v = X ■ V mod My. 

Theorem 3. For the pairs {G,P) satisfying Theorem 2, there exists an al- 
gebraic P-invariant stratification g/p = ufLiXi such that for any V G IHg, 
the function rk Fy is constant along each Xi . In other words, the linear span 
of functions ^:\^Fv in the algebra of constructible functions on g/p is finite- 
dimensional. 

If the stratification is known explicitly it allows one to solve the following 
classical geometric problem: For any irreducible equivariant spanned vector 
bundle £ on G/P, determine whether its generic global section has zeros. This 
class of geometric problems includes, for example, the exact estimates on the 
maximal possible dimension of a projective subspace in a generic projective 
hypersurface of given degree, or of an isotropic subspace of a generic skew- 
symmetric form of given degree. The corresponding algorithm and examples 
were given in [Te2j. 
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The stratification from Theorem 3 provides an alternative to the orbit 
decomposition for the action of P~ on g/p^. It is known that this action has 
an open orbit, see [LW]; however the number of orbits is usually infinite, see 
[PR], [BHR], 

All necessary facts about complex and real Lie groups. Lie algebras, and 
algebraic groups used in this paper without specific references can be found 
in [OVj. In particular, we enumerate simple roots of simple Lie algebras as 
in [loc. cit.j If g is a simple group of rank r then ai, . . . ,Ur denote its simple 
roots, ipi, . . . ,(pr denote its fundamental weights. For any dominant weight A 
we denote by R{X) the irreducible representation of highest weight A. 

This paper was written during my stay at the Erwin Schrddinger Institute 
in Vienna and at the University of Glasgow. I would like to thank my hosts, 
especially Sergei Merkulov and Roger Bielawski, for the warm hospitality. I am 
grateful to the referees for numerous corrections and improvements. 



1 Hermitian Characteristics In Classical Groups 

In this section we give some background information, prove Theorem 1 for 
classical groups, and prove Theorem 2. We recall the notion of the Moore- 
Penrose inverse of linear maps. Let Vi and V 2 be vector spaces with Hermitian 
scalar products. For any linear map F : Vi ^ V 2 its Moore-Penrose inverse 
is a linear map F+ : V 2 ^ Vi defined as follows. Consider KerF C Vi and 
ImF C ¥ 2 - Let Ker“''F C V\ and Im''‘F C V 2 be their orthogonal com- 
plements with respect to the Hermitian scalar products. Then F defines via 
restriction a bijective linear map F : Ker“''F — > ImF. Then F+ : V 2 ^ Ui 
is a unique linear map such that = 0 and = F~^. It is 

easy to see that F+ is the unique solution of the following system of Fenrose 
equations: 

F~^FF^ = F~^ , FF^F = F, FF^ and F~^F are Hermitian. (*) 
For example, if F is invertible then F+ = F~^. 

Proof of Theorem 1 in case 0 / GL(U) and SL(U). Suppose now that g = 
g[(U) and take any decomposition V = Ui 0 . . . 0 14- Then we have a block 
decomposition gl(U) = The parabolic subalgebra p = 

Qi<j Hom(Vi,Vj) has the unipotent radical n = Hom(Vi, Vj) and any 
parabolic subalgebra in g[(U) has this form. Consider the corresponding Z- 
grading. Then 1 = gl(U)o = 0i=i End(U) and all other rectangular blocks 
Hom(Vi, Vj) get different grades. 

We claim that for any collection {e^}, G Hom(Vi,Vj), i < j, there 
exists a unique Hermitian multiple characteristic with respect to any compact 
real form of [. Indeed, we fix Hermitian scalar products in Vi, . . . ,Vk and set 
t = 0iL;^u(U), where u(U) is the Lie algebra of skew-Hermitian operators. 
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Any compact real form of [ has this presentation. Now let us take Moore- 
Penrose inverses fji = G Hom(V^, Pi) of elements e^. The equations (*) 
are equivalent to the statement that {eij,hij = [^ij, fji], fji) is an sl 2 -triple 
containing with a Hermitian characteristic hij. Therefore, is a 

unique Hermitian multiple characteristic of {eij}. The same argument applies 
forsI(P). □ 

Definitions. 

• An element x € A.d{L) -orbit O are called ample if for any 

G O there exists a homogeneous sl 2 ~triple {e^jh^, f^) with h^ G it. 

• The Z -grading ofg is ample in degree x if all Ad{L)-orbits in are ample. 

• A parabolic subgroup P is called weakly ample if for every e G n, there 
exists I G L such that Ad(l)e admits a Hermitian multiple characteristic. 

A non-zero weight x G ^ is called reduced if Q2x = 0- 

Basic Lemma. If x & Z is reduced then the grading is ample in degree x- 

This lemma was proved in [Tel]. It shows that almost all components of 
the grading are automatically ample. 

Theorem 1 in the remaining classical cases follows from Theorem 4 below. 

Theorem 4. Any parabolic subgroup in SO„(C) or Sp„(C) is weakly ample. 

Proof of Theorem f. Suppose that V = C" is a complex vector space endowed 
with a non-degenerate bilinear form u which is either symmetric or skew- 
symmetric. We denote by G{uj) C SL(P) the corresponding special orthogonal 
or symplectic group of automorphisms of V preserving to. Let g C s((P) be 
its Lie algebra of skew-symmetric operators with respect to u. The subspace 
17 C P is called isotropic if uj vanishes on U. Let 0 = Fq C Fi C . . . C Fk C V 
be a flag of isotropic subspaces. Then the stabilizer P of this flag in G{uj) is 
a parabolic subgroup and any parabolic subgroup has this form. 

In order to flx the Levi subgroup of P, we choose subspaces C Fk 
complementary to Fk-i and we choose an isotropic subspace Gk transversal 
to Fk such that the restriction of uj to Fk (B Gk is non-degenerate. Then the 
subgroup L of G{oj) preserving both , . . . , and Gk is a Levi subgroup 
of P. Fk and Gk are naturally dual to each other with respect to the bilinear 
form: any v G Gk defines a linear functional uj{v, •) on Fk. Let Gk = Ui 0 
. ■ -0 17^ be the decomposition dual to the decomposition Fk = 11^ (B ■ . -(BU^ . 
Let IP = {Fk 0 Gfc)-*-. Then L automatically preserves Ui , . . . , and IP. 
The semisimple part of ( is isomorphic to 0 . . . 0 s((C/jr) 0 g(IP), where 

g(IP) is the Lie algebra of skew-symmetric operators of IP. Each sl{U~) acts 
naturally in U~ , dually on IT^, and trivially on IP and on LL*", U~ for j yf i. 
g(IP) acts naturally on IP and trivially on Fk 0 Gk. The center 3 of I acts 
on by scalar transformations XkE, on by —XkE, and trivially on IP. 
Here Ai, . . . , Afc is a basis of 3 *. 
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The choice of a compact form in [ is equivalent to the choice of a compact 
form in each sl{U~) (i.e. the choice of a Hermitian scalar product in U~) 
and a compact form t{W) of q{W). We shall vary Hermitian scalar products 
in U~ later, but the compact real form of q{W) is to be fixed once and for 
all. We fix a basis b\, . . . ,bm of W such that the matrix of co in this basis is 

equal to I, where J = Id in the symmetric case and ^ ~ ^ ™ 

skew-symmetric case. We fix a standard Hermitian form in W by the formula 
{u, u} = iv{u, I*v). Then the subalgebra i(W) of skew-Hermitian operators in 
q{W) is its compact real form. 

Non-trivial Z-graded components of g can be described as follows. 

• Any linear operator Aij : U^, i ^ j gives by duality the linear 

operator : U~ U~ . We define the skew-symmetric operator Aij by 
setting Aij\jj+ = Aij, Aij\jj- = —A[j] the restriction of Aij to other 

components of the decomposition V = (Bk 0 (Bk 0 W is trivial. 

These operators form which belongs to n if i > j. 

• Any linear operator A[ ■. W ^ (resp. A' : W ^ U~) determines by 

duality the linear operator Ai : U~ W (resp. Ai : W), where we 

identify W and W*, w i-^- u{w, •). We define the skew-symmetric operator 
Ai by setting Ai\w = A', Ai\jjT = — A^; the restriction of Ai to other 
components of the decomposition V = (Bk 0 0fc 0 IT is trivial. 

These operators form g^^ C n (resp. g^A;)- 

• Any linear operator Bij : U~ (resp. Bij : U(^ J 

determines by duality the linear operator : U~ U(^ (resp. B[j : 

U~). We define the skew-symmetric operator Bij with respect to 
oj by setting Bij\jjj = Bij, Bij\jj± = —B[j; the restriction of Bij to other 

components of the decomposition V = (Bk U'^ 0 0fc 0 W is trivial. 
These operators form gVi-i-Aj C n (resp. g_Ai-A3)- 

• Finally, any skew-symmetric linear operator Bi : U~ (resp. Bi : 

U~) defines the skew-symmetric operator 13 i with respect to co: 
BilijT = Bi; the restriction of Bi to other components of the decomposi- 
tion V = (Bk 0 0fc UjB 0 IT is trivial. These operators form g 2 Aj C n 
(resp. g_ 2 Ai)- This component is trivial if dimf/^^ = 1. 

By the Basic Lemma, if Q2x = 0 then for any e G and for any compact 
form t C 1 there exists a homogeneous 5(2 triple (e, h, f) with a Hermitian 
characteristic h G ii. Therefore, in our case it remains to prove that for any 
set of elements Ci G gvo i = I, ■■■ ,k there exists a compact form t C 1 and a 
Hermitian multiple characteristic hi € it, i = 1, . ■ . , k. 

Any Ci is defined by a linear map Aj : U~ IT, and fi G g_Ai is 
defined by a linear map Bi : W ^ U~ . Using the description of weighted 
components of g given above, it is easy to see that and fi can be embedded 
in a homogeneous s^-triple if and only if Ai and Bi satisfy the following 
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system of matrix equations 

2Ai = 2A^B,A, - {A,Bi)*A„ 2B, = 2B,A,Bi - B,{A,Bi)* , 

where for any A G Hom(hE, W) we denote by A"^ its adjoint operator with 
respect to ui. Moreover, the characteristic of this sl 2 -triple will be Hermitian 
if and only if 



BiAi, AiBi — (AiBi)"^ are Hermitian operators. 

Therefore, it remains to prove the following lemma. 

Lemma. Suppose that U = C", IT = are complex vector spaces. Let io be 
a non- degenerate symmetric {resp. skew-symmetric) form on W with matrix 

I = Id, resp. ^ ® standard Hermitian form in W . Let 

A G Hom(C/, IT). Then there exists a Hermitian form on U and an operator 
B G Hom(IT, U) such that 

2A = 2ABA- {AB)*A, 2B = 2BAB - B{AB)* , (*) 

BA, AB — (AB)"^ are Hermitian operators, (**) 

where for any A G Hom(IT, IT) we denote by A# its adjoint operator with 
respect to oj. 

Proof. Let Wq = Kerwjimyi, let ITi be the orthogonal complement to Wq in 
ImA with respect to the Hermitian form. Let U 2 = KerH. Choose a subspace 
U G U complementary to C/ 2 . Then A defines a bijective linear map A : U —>■ 
1mA. Let Uq = A“^(ITo), Ui = H“^(ITi). We fix a Hermitian form on U 
such that Uq, Ui, and U 2 are pairwise orthogonal and claim that the system 
of equations (*, **) has a solution. 

Let IT 2 = IWo, where bar denotes the complex conjugation. Then ITq C 
W 2 = {0}, the restriction of a; to ITq 0 IT 2 is non-degenerate, and Wq © IT 2 is 
orthogonal to ITi both with respect to u and with respect to the Hermitian 
form. Let IT 3 be the orthogonal complement to Wq © ITi © IT 2 with respect 
to the Hermitian form. 

We define the operator B as follows: 

B\wo = " 4 “^, B\wi = 2A~^, B\w 2 = B\ws = 0 . 

Then we have 

AB\wo = Id, Ai?|wi = 2 • Id, AB\\y2 = ABlyy^ = 0, 



therefore 



{AB)*\wo = 0, {AB)*\w, = 2 • Id, {AB)*\w2 = Id, {AB)*\w, = 0. 
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Since Wq, Wi, W2, and W3 are pairwise orthogonal with respect to the Her- 
mitian form, it follows that AB — (AB)"^ is a Hermitian operator. It is easy 
to check that (*) holds. Now, we have 

BA\uo = Id, BA\u, = 2 • Id, BA\u, = 0. 

Since Uq, U\, and C/2 are pairwise orthogonal with respect to the Hermitian 
form, it follows that BA is also a Hermitian operator. □ 

Proof of Theorem 2. Until the end of this section “an algebraic subvariety” 
means “a union of locally closed subvarieties” . To avoid repetition, we consider 
the coadjoint case only; the adjoint case is absolutely similar. 

Let e G n. We need to prove that there exists p G P such that Ad(p)e ad- 
mits a multiple characteristic {h^} with reductive (Cix)aig- We can substitute 
the base field k by an algebraic closure of a subfield generated by coefficients 
of e in a fixed basis compatible with the grading. This shows that, without 
loss of generality, we may assume that k is embedded into C By Theorem 1, 
and there exists p' G T*(C) such that Ad(p')e admits a Hermitian multiple 
characteristic {h'^} (defined over C). It easily follows (see [Tel]) that (Ci^aig 
is reductive. Let lU C n be the subset of all points that admit a multiple 
characteristic {h^} with reductive {h^)aig- We are going to show that lU is a 
subvariety defined over k. Then the argument above implies that Ad(P)eH W 
is non-empty over C, hence non-empty over k, hence the Theorem. 

Let n be the number of positive weights. Consider the variety of sf2-triples 

S'C © flx®0o"® ® flx: 

x<0 x>0 

^ = {/x ^ 0-x) ^x € 00 , & 3x\ 

[®X’/x] = ^X! [^X5 ®x] = [h^, f^] = —2f^} . 

Let 7Ti denote the projection of S on g®", tt2 denote the projection of S on 
n. These projections are defined over k. Let R denote the set of n-tuples of 
points (xi, . . . , Xn) G 0®" such that (xi, . . . , x„)aig is reductive. Then, clearly, 
W = TT2{TTf^{R)). Therefore, it suffices to show that i? is a subvariety of 0®”. 
By a theorem of Richardson [Ri], (xi, . . . , x„)aig is reductive if and only if the 
orbit of (xi, . . . ,x„) G 0®” is closed with respect to the diagonal action of 
L = Go- It remains to notice that if a reductive group L acts on an affine 
variety X then the union of the closed orbits F C A is a subvariety (defined 
over the field of definition of the action). Indeed, one can argue using induction 
on dim X and the two following observations (their proofs can be found in 
[Vi]): If generic G-orbits in X are not closed then there exists a proper closed 
subvariety Xq C X that contains all closed orbits. If generic G-orbits in X 
are closed then there exists an open G-invariant subset U G X such that all 
orbits in U are closed in X. Then we may pass from X to X \ U. 
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2 Exceptional Groups 



The proof of Theorem 1 for the classical groups given above relies on the fact 
that their block decompositions can be easily understood in terms of linear 
algebra. However, block decompositions of exceptional groups are much more 
complicated, diverse, and interesting. Here we collect some important results 
about these decompositions. The actual proof of Theorem 1 will be finished 
in Section 3. 



2.0 Comparison Lemma 

It follows from the Basic Lemma that if all positive weights x G 2' are reduced 
except at most one, then the corresponding parabolic subgroup is weakly 
ample. Indeed, let e G n and let x b® tbe only non-reduced weight. Take 
any homogeneous characteristic of e^. Then there exists I G L such that 
Ad{l)hx G it because all compact real forms of [ are conjugate, see also [Tel]. 
It follows that Ad(/)e admits a Hermitian multiple characteristic. Therefore, 
we need to prove Theorem 1 only for parabolic subgroups such that there exist 
two or more not reduced Z- weights. Moreover, some non-reduced weights may 
also correspond to ample components of the grading. The following lemma 
provides a lot of examples. 

Comparison Lemma. Let G' and G" he reductive algebraic groups with Lie 
algebras g' and g", parabolic subgroups P' C G' and P" C G" , and Levi 
subgroups L' C P' and L" C P" . Let Z' and Z" he the centers of L' and 
L" . Consider positive weights x' G Z' and x!' G Z" . Suppose that [L',L'] = 
[L'',L''] = H and the H -modules and g"// coincide. Suppose that H is 
either simple or isomorphic to SL„ x SL^, in which case ~ g'^„ ~ C"(ZC’" 

as an H -module. Then the Z' -grading of g' is ample in degree x' iff ths - 
grading of g" is ample in degree x" ■ 

Proof. We may assume without loss of generality that P' and P" are maximal 
parabolic subgroups. Let [) be the Lie algebra of H. Consider two local Lie 
algebras g'_^, © gg © g]^, and g"^„ © gg © g"„. We choose d G 3 ' and c" G 3 " 
such that ad(c')|g^ ^ = ±Id and ad(c")|g" = ±Id. Then gg = Cc' © f) 

and gg = Cc" © f). We fix compact real forms T C gg and 6" C gg. Then 
I' = iMc' © m and i" = iKc" © m, where m is a compact real form in tj. 
Suppose that e' G g'^, and the Z'-grading of g' is ample in degree xf ■ Then 
there exists /' G g'_^, such that (e', h' = [e', /'],/') is an s[ 2 -triple and h' G H' . 
Let h' = h\ + h' 2 , where h\ G iKc' and h '2 G tm. Let Ij = ©f)p be the direct 
sum of simple Lie algebras. Then we have the corresponding decomposition 
m = ©tUp and h '2 = X[(^ 2 )p- We can identify gg and gg as Lie algebras by 
assigning c" to c'. Then we can identify g^, with g"„ and g'_^, with g"„ as 
their modules. Let e" G g",, correspond to e' and /" G g'fyi correspond to 
/'. Let h” = [e",/"j = h" + h'f, where h'{ G Cc" and h '2 G f), h '2 = J2i^2)p- 
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We claim that h" G it" and its real multiple is a characteristic of e". It would 
follow that the ^"-grading of g" is ample in degree x” ■ 

Let h' = h'l + h '2 be the corresponding element of 0q, where h'l G Cc' 
and h '2 G f), h '2 = X)(^ 2 )p- It is sufficient to prove that h'l = ah\ and (/i 2 )p = 
Pp(h' 2 )p, where a and l3 are positive real numbers (here we use our restrictions 
to H). The commutator maps 

0 g^' ^ go and : g" O g"„ ^ g[,' 

can be decomposed as = Q' o <P" = 17" o , where 'F' and F" are 
moment maps and 17' : (gj))* ^ gj), 17" : (gp)* ^ gg are pairings given by 
K' and K", where K' , K" are restrictions of the Killing forms in g' and g" 
to gg and gg. Under the identifications above we have iF' = F" . It remains 
to notice that Cc' is orthogonal to f) under K' , Cc" is orthogonal to f) under 
K", the restrictions of K' and K" to (f))p coincide with the Killing form of 
{t))p multiplied by a positive real number, and that K'{c',c') and K"{c",c") 
are both real and positive. □ 

For instance, take a maximal parabolic subgroup of F 4 . Then the corre- 
sponding grading is g = Qi, where N is equal to 2, 3, or 4. In the first 

and the second case all weights but one are reduced and everything follows 
from the Basic Lemma. If = 4 then there are two non-reduced weights, 
namely 1 and 2. However, the representation of [L, L] on gi in this case is 
locally isomorphic to the representation of SL 2 x SL 3 on C^ © C^ and the 
result follows from the Comparison Lemma. 

Using these simple arguments, it is easy to verify that all parabolic sub- 
groups not listed in the table at the end of the paper are weakly ample (in 
particular, all parabolic subgroups in G 2 , F 4 and Eq are weakly ample). The- 
orem 1 for the entries 1~37 from the table will be checked in the next sections. 
Entries 38-59 will be verified in the sequel of this paper. 

2.1 Non- degenerate Deformations 

A projective variety X C P(U) is called a 2-variety if it is cut out by quadrics, 
i.e. its homogeneous ideal I G C[U] is generated by l 2 - For example, if G is 
a semi-simple Lie group and V is an irreducible G- module then the projec- 
tivization of the cone of highest weight vectors in U is a 2 - variety by a result 
of B. Kostant (see also [Li]). Suppose that X C P(U) is a 2-variety. A linear 
map A ■. ^ U is called degenerate if dimlm A = 2 and P(Im A) n A is a 

point. 

Proposition 1. (A) If A : C'^ ^ V is degenerate, and B G Hom(C^,C^) 
is non-trivial, then there exists C G Hom(C^,U) such that A+ CB is non- 
degenerate. 

(B) If A, B : ^ U are degenerate, then there exists E G Hom(C^,C^) 

such that A BE is non- degenerate. 
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(C) Suppose A : C'^ ^ V is degenerate, and v € V does not belong to the 
cone over X. Then there exists / € (C^)* such that A+v- f is non-degenerate. 

Proof. (A) Clearly, we can choose C such that dimIm(A + CB) < 2. 

(B) If (ImA) n (Imi?) yf 0 then there exists E G Hom(C^,C^) such that 
we have inequality dimIm(A + BE) < 2 and we are done. Otherwise, let 
Vo = (ImA) + (ImS), Xq = X f] P(Vo). Clearly, dimVb = 4 and Xq is a 2- 
variety in P(Vb). We take skew lines Iq = P(ImA) and l\ = P(ImB). Each of 
them intersects Xq at a point. For any E G Hom(C^, C^), dimIm(A+Bif) = 2. 
A line I C P(Vb) is equal to P(Im(A + BE)) for some E G Hom(C^, C^) if and 
only if / n = 0 . 

Clearly, dim Xq < 3. If dimXo < 2 then there exists a line I C P(Vb) such 
that I O li = I O Xq = 0 and we are done. Otherwise, since l\ Xq, there 
exist hyperplanes i?i,B 2 C P(C) and points pi G Hi, p2 G H2 such that 
/i = n H 2 , Pi,P2 ^ h, Pi,P2 G Xq. Then the line I connecting pi and p2 
does not intersect h and either intersects Xq in two points or belongs to Xq. 

(C) Indeed, if u G Im A, then we can find / such that dimIm(A+w-/) < 2. 
Suppose that v ^ Im A. Then any 2-dimensional subspace in U = (v) Im A 
not containing v can be realised as Im(A-|- w • /) for some /. Let Y = PC/ n X, 
b G PC/ be the point corresponding to v. Then b ^ Y. We need to find a line I 
in PC/ such that b ^ I and lOY is not a point. If dimF = 0, then we can find 
a line that does not intersect b and Y at all. If dim Y = 1 and Y has a line as 
an irreducible component, then we can take this component as a line we are 
looking for. Finally, in the remaining cases a generic line in PC/ intersects Y 
in more then one (actually, two) points. □ 

2.2 Kac Theorem 

Consider the E-graded reductive Lie algebra g = X 0- Let O 

denote the open L-orbit in e G O. Kac has proved in [Ka] that there 
exists an s[ 2 -triple (e, h, /) with G 3 if and only if the complement of O has 
codimension 1. In particular, we have the following proposition: 

Proposition 2. If O is open and its complement has codimension 1, then O 
is ample. 

The list of representations of [L, L] on g,^ with the above property can be 
found in [loc. cit.]. 

2.3 Witt’s Theorem 

The following proposition is well known as Witt’s Theorem. 

Proposition 3. Consider a vector space W endowed with a non-degenerate 
quadratic form Q. Orbits o/GL(K) x 0{W) on Hom(y,IT) are parametrized 
by pairs of integers (i,j) such that 
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0 < i < min(dim V, dim W), 0 < j < min(i, dim W — i). 

Here A G Hom{V,W) corresponds to the pair (dimGl,dimKer(5|dimyt)- 

With respect to the action of GL(F) x SO(W), some of these orbits may 
split into two orbits. This action appears as the action of a Levi subgroup of 
a maximal parabolic subgroup in G = SO„ on gi. It was shown in [Tel] that 
ample orbits correspond to pairs (fc, 0) and (k,k). More precisely, a linear 
map A : ^ C" (or the corresponding tensor A G (C^)* 0 C"), where 

C" is endowed with a non-degenerate scalar product, is called ample if the 
restriction of the scalar product in C" to Im A is either non-degenerate or 
trivial. 

Proposition 4. Let V = C" be endowed with a non-degenerate scalar product. 

(A) Let k < 3 or k = n = A. Suppose that the linear map A : ^ V is 

not ample, and the linear map B : C* ^ is not trivial. Then A CB is 
ample for some C G Hom(C^, V). 

(B) Let n < 4. Suppose that the linear map A-. ^ V is not ample, and 

V G V is not trivial. Then there exists a linear function f : (C^)* such that 
A-\- V ■ f is ample. 

Proof. Simple calculation. □ 

The tensor A G C* 0 may be considered as a linear map Aq : 

(C*)* ^ (C^ 0 C^). The space ® has a canonical quadratic form det. 
A is called not ample if the restriction of det to Im Aq is degenerate but not 
trivial. A may also be viewed as a linear map A : (C^)* ^ (C^ 0 C^). Then 
A is not ample if and only if Im A is 2-dimensional and (Im A) n i? is a line, 
where i? C is the variety of rank 1 matrices. 

Proposition 5. (A) Suppose that the linear maps A : ^ (C^ 0 C^) and 

B : C'^ ^ (C^ 0 A^C^) are not ample. Then there exists E G End(C^) 0 
such that B E o A is ample; here we embed in Hom(C^, A^C^) in the 
obvious way. 

(B) Suppose that the linear map A : A^C^ ^ (C^ ® C^) is not ample, 
and B G Hom(C^,C^) is not trivial. Then there exists a linear map C G 
Hom(C^,C^) such that A-\- B /\C is ample. 

(C) Let v G C^, v 0, B G (A^C^) 0 C^. Then there exists A G 
such that B -G v A A G (A^C^) ® has rank 2. 

Proof. (A) Direct calculation shows that there exists Eq G End(C^)®C^ such 
that Eq o A belongs to the open orbit in Hom(C^,C^ 0 A^C^) with respect 
to the group G = GL 2 x GL 2 x GL 3 . This complement of this orbit has 
codimension 1, therefore there exists A G C such that B XEq o A belongs to 
this open orbit. Now we can take E = XEq by Proposition 2. 

(B) Suppose first that dimimi? = 2. We take a basis { 61 , 62 , 63 } of 
such that 5 ( 63 ) = 0. If we take C such that G( 63 ) = 0, then B A G(ei A 63 ) = 
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B A C{e2 A 63) = 0 and B A C(ei A 62) can be made arbitrary. Thus we are 
done by Proposition 4. A. 

Suppose now that dim Im B = 1. Then the linear space of all possible maps 
of the form B AC consists of all linear maps X : (C^ 0 C^) such that 

KerX D R and ImX C L, where i? C is a fixed 1-dimensional subspace 
and L C is a fixed 2-dimensional subspace isotropic with respect to 

det. We need to consider two cases: dimlm A = 2 and dimImA = 3. 

Let dimlm A = 2. We fix a basis {ei, 62, 63} of A^C^ such that A(ei) = 0 
and V = A(e2) spans the kernel of restriction of det to {v, u), where u = A(e3). 
Clearly, we may assume that R is spanned by ei, 62, or 63. If i? = Cei and 
L O {v,u) = 0 then we can choose X such that Im(A -|- X) is an arbitrary 
2-dimensional subspace not intersecting L and the claim obviously follows. If 
R = Cei and L n (w, m) yf 0 then we can choose X such that dim(A + X) < 2 
and we are done. If i? = Cc2 and v ^ L then we can find w € L such that 

V and w are not orthogonal. Then we take the map X such that A'(ei) = w, 
X(e3) = 0. Im(A -|- X) is 3-dimensional and non-degenerate with respect to 
det. If i? = Cc2 and v G L then we take X such that A'(ei) = 0 and M-|-^(e3) 
is isotropic with respect to det. This is possible, because the orthogonal 
complement to L is L itself, but u ^ L. Then Im(A-l-X) is 2-dimensional and 
isotropic with respect to det. If i? = Cc3 and v ^ L then we can find w G L 
such that V and w are not orthogonal. Then we take the map X such that 
X{ei) = w, X{e2) = 0. Im(A-|- X) is 3-dimensional and non-degenerate with 
respect to det. If i? = Ces and v G L then we take X such that X{e2) = —v 
and A'(ei) is not orthogonal to u with respect to det. This is possible, because 
the orthogonal complement to L is L itself, but u ^ L. Then Im(A -|- X) is 
2 -dimensional and non-degenerate with respect to det. 

Now let dimlm A = 3. We fix a basis {61,62,63} of A^C^ such that 

V = A(6i) spans the kernel of the restriction of det to ImA, u = A(62) 
and w = A(e3) are isotropic. We may assume that R either belongs to (62, 63) 
or coincides with Cei. 

Let R C (62, 63). liv ^ L, then we take x G L such that v is not orthogonal 
to X. We take an operator X such that X{e2) = -^(63) = 0, -A(ei) = Xx, 
X G C. Then Im(A -|- X) is 3-dimensional and non-degenerate with respect 
to det for generic A. If f G L, then we take X such that X{ei) = —v, 
X(e2) = X{e^) = 0. Then Im(A -|- X) is 2-dimensional and non-degenerate 
with respect to det. 

Let R = Cci. li V ^ L, then we take x G L such that v is not orthogonal 
to X. We take an operator X such that X{ei) = 0, -^(62) = X{e3) = x. 
Then Im(A -|- X) is 3-dimensional and non-degenerate with respect to det. 
If V G L then either L = (v, u) or L = {v, w). It is sufficient to consider only 
the first case. We take X such that A'(6i) = 0, -^(62) = —u, ^^(63) = 0. Then 
Im(A -I- X) = (v, w) is 2-dimensional and isotropic. 

(C) We fix a basis (ei, 62, 63} of such that v = e\ and a basis |/i, /2j 
of C^. We take A = 62 0/1-1-63 0/2. Then vAA = (ei A 62)0/1 -I- (61 A 63) 0/2 
has rank 2. Therefore, B + v A XA has rank 2 for some X G C. □ 
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A tensor A G is called ample if the restriction of the quadratic 

form Pf to ImA is trivial or non-degenerate, where A : (C^)* ^ A^C"* is the 
corresponding map. 

Proposition 6. (A) Suppose that the linear maps A : ^ and B : 

^ A^C"* are not ample. Then there exists a map C : ^ C"* such 

that B + A A C is ample. 

(B) Suppose that the linear maps A : A^C^ ^ and B : ^ (C^0C^) 

are not ample. Then there exists a map C : C'^ ^ (C^)*(8>C such that A+BAC 
is ample. 

(C) Suppose that the linear map A : ^ A^C^ is not ample, and w G 

is not trivial. Then there exists a map B : ^ C"* such that A + w A B is 

ample. 

(D) Suppose that A G C"*® A^C"* is not ample. If B G A^C^® A^C"* is not 

ample, then there exists C G such that B + A A C is ample. 

(E) Suppose that A G A^C^ is not ample. If u G C"*, m A 0 ; then there 

exists C = 'Yf Vi ® Wi G such that A + ^Vi^ {wi A u) is ample. 

Proof. (A) It suffices to find C such that A A C belongs to the open orbit, 

because it is ample. We fix bases {ei, C2, 63, 64} of C^, {/i, /2} of the first C^, 
{(71,52} of the second C^. We may assume that A(/i) = ei A 62 -I- 63 A 64, 
A(/2) = Cl a 63. Consider C such that C(5i) = 64, C{g2) = e^. Then A A C 
is an isomorphism. 

(B) If dimS = 3 , then there exists a map C : ^ (C^)* ® C such that 

A+ B AC belongs to the open orbit, hence it is ample. Let dim B = 2 . Simple 
calculations show that we need to prove the following claim. 

Let {61,62,63,64} (resp. {/i,/2}) be a basis of C'^ (resp. of C^). Suppose 

that the map A : ^ A^C"* is not ample. Then we claim that there exist 

vectors v,u gC^ such that the map B is ample, where B{fi) = A{fi) + eiAu, 
B{f2) = A{f2) + C2Au + eiAv. Indeed, dim ImA = 2 and we may assume that 
either A(/i) or A(/2) spans the kernel of the restriction ofPfto ImA. Consider 
the first case. If A(/i) = 61 A ic, then we take u = 0 , u = —w. If A(/i) is not 
of the form ei A w, then there exists v such that A(/i) A ei A u A 0 - If we take 
■u = 0 , then B is ample. Consider the second case. Since A(/i) A A(/i) A Oj 
we can find w such that A(/i) A ei A ic A 0 - If 'i' = and u = 0, then B is 
ample for generic A G C. 

(C) We fix a basis {ei, 62, 63, 64} of such that w = ei and a basis {/i, /2} 

such that A(/i) spans the kernel of the restriction of Pf to ImA. We need to 
prove that there exist u,v G such that the linear map C : ^ A^C"* is 

ample, where C(/i) = A{fi) + eiAu, C(f2) = A{f2) + eiAv. If A(/i) = eiAx, 
then it suffices to take u = —x. Otherwise, we take u = 0 and we choose v 
such that A(/i) A 61 A u A 0 - Then dimlmC = 2 and the restriction of Pf to 
Im C is non-degenerate. 

(D) and (E). Let A : (C"')* ^ A^C^ be the corresponding map. Since the 
restriction of Pf to Im A is degenerate but not trivial, in suitable bases A has 
one of the following forms: 
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Ax = ei® (/i A /2 + /s A fi) + C2® (/i A /s), 

^2 = ei (g) (/i A /2 + /s A U) + 62 (g (/l A /s) + 63 g (/i A / 4 ), 

^3 = ei g (/i A /2 + /a A U) + 62 g (/i A /s) + 63 g (/s A /4), 

A4 = 61 g (/i A /2 + /a A U) + 62 g (/i A /a) + 63 g (/i A U) + 64 g (/i A /2), 
^5 = ei g (/i A /2 + /a A U) + 62 g (/i A /a) + 63 g (/i A U) + 64 g (/2 A /4). 

(D) We take C = 63 g /2 + 64 g /4. Then 

A A C = (61 A 63) g (/2 A /a A / 4 ) - (62 A 63) g (/i A /2 A /a) 

+ (61 A 64) g (/i A /2 A /4) + (62 A 64) g (/i A /a A /4). 

The restriction of Pf to the 4 -dimensional image of the corresponding map is 
non-degenerate, so A A C belongs to the open orbit, which is ample by the 
results of § 3 . 2 . Therefore, B + AA (AC) is also ample for some A S C. 

(E) Let A = Ai. If M G (/ij/a), then we take C = 62 g m' such that 
u'Au = — /1A/3. If M ^ (/i, /a)) then there exists u' such that fiAf^Au' Au yf 0 
and we take C = ci g u' . 

Let A = A2 or A4. If u ^ (/i, /a)) then there exists u' such that /i A /a A 
■u' A M yf 0 and we take C = 63 g m'. If rt ^ (/i, /4)> then there exists u' such 
that /i A /4 A u' A M yi: 0 and we take C = 62 g u' . Finally, if w = A/i, then we 
take C = (c2 g /a + 63 g A) /A. 

Let A = As. If w G (/i, /a), then we take C = 62 g m' such that u' Au = 
~fi A /a. If M ^ (/i; /a)) then there exists u' such that /i A /a A u' A w yf 0 and 
we take C = 63 g u' . 

Let A = A5. If M G (/i, /4), then we take C = es®u' such that u' Au = 
~fi A /4. If w ^ (/i; A)) then there exists u' such that /i A /4 A u' A m yf 0 and 
we take C = ei g mA □ 

2.4 Spinors 

We recall the definition of half-spinor representations. Let V = be an 
even-dimensional vector space with a non-degenerate symmetric scalar pro- 
duct (• , •). Let Cl(IA) be the Clifford algebra of V. Recall that C 1 (P) is in fact 
a superalgebra, C 1 (P) = C 1 °(P) ©Cl^(P), where C 1 °(P) (resp. Cl^(lA)) is the 
linear span of elements of the form vi - . . . • Vr, Vi G V, where r is even (resp. r 
is odd). Then we have 

Spin(P) = {a G C 1 °(P) \ a = vi ■ . . . ■ Vr, Vj G P, Q{vi, Vi) = 1 }. 

Spin(P) is a connected simply connected algebraic group. 

Given a G C 1 (P), a = vi • . . . • Vr, Vi G P, let a = (— l)’’Wr. • . . . ■ vi. This 
is a well-defined involution of C 1 (P). Using it, we may define an action R of 
Spin(P) on P by the formula R(a)v = a • v ■ a. Then i? is a double covering 
Spin(P) ^ SO(P). 
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Let U <ZV he & maximal isotropic subspace, hence dim U = m. Take also 
any maximal isotropic subspace U' such that U (B U' = V. For any v G U we 
define an operator p(v) G End(yl*[/) by the formula 

p{v) • Ui A . . . A Ur = V A Ui A . . . Ur- 

For any v G U' we define an operator p(v) G End(yl*[/) by the formula 

r 

p{v) ■ U\ A ... A Ur = Ui) A t6i A . . . Ui-I A Ui+\ A ... A Ur. 

i=l 

These operators are well-defined and therefore by linearity we have a lin- 
ear map p '. V ^ End(yl*[/). It is easy to check that for any v G V we 
have p{vY' = (w,w)Id. Therefore we have a homomorphism of associative al- 
gebras C1(E) ^ End(yl*[/), i.e., A*U is a Cl(E)-module, easily seen to be 
irreducible. Therefore, A*U is also a Spin(E)-module (spinor representation), 
now reducible. However, the even part A^'^U is an irreducible Spin(E)-module, 
called the half-spinor module S~^ . Another irreducible half-spinor module S~ 
is defined as A°'^U. 

The map p defines a morphism of Spin(E) modules V 0 S^. If m is 

odd, then is dual to S~ . If m is even, then the spinor representation A*U 
admits an interesting non-degenerate bilinear form (• , •) defined as follows. 
Let det G A^U be a fixed non-trivial element. Then {u,v) is equal to the 
coefficient of det of the element (— l)t * luA v. Obviously, S'"*" is orthogonal 
to S~ and the restriction of (u, v) to is orthogonal if m = 4/c and symplectic 
ii m = Ak + 2. In particular, and S~ are self-dual if m is even. 

If TO = 4, then V, S'+ and S~ are twisted forms of each other with respect 
to outer isomorphisms of Spiug (triality principle). Let E = C® be a vector 
space equipped with a non-degenerate scalar product. We denote by S'^, S~ 
the corresponding half-spinor modules. If R denotes V, S'+, or S~ , then a 
tensor A € 0 i? is called ample if the restriction of the scalar product of R 

to Im A is trivial or non-degenerate, where A : (C*)* ^ i? is the corresponding 
map. 

Proposition 7. (A) Let k = 2,3. If A = G C^(8>S'+ and B G C^(8>S'“ 

are not ample, then there exists v G V such that C = H -|- 0 p{v)si is 

ample. 

(B) // A = ^ Oi (8> Si e C® 0 and B G A^C® 0 S~ are not ample, then 

there exists cc = X) ® ■Si € C® 0 E such that C = B + Yi ® p{xj)si 

is ample. 

(C) // A G C® 0 S~ is not ample and s G is not trivial, then there 
exists H ^ Oi 0 rci G C® 0 E such that C = A + Y*^i® p{wi)s is ample. 

Proof. (A) Let k = 2. We choose a basis f\,fi of and 61,62,63,64 of U 
(maximal isotropic subspace of E) such that 



A = /i 0 1 + /2 0 (ei A 62 + 63 A 64), B = fi Xi + f2 X2. 
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If xi G U C A°'^U then we take v = —xi. Otherwise, there exists v' G U' such 
that p{v'){e\ A 62 + 63 A 64) is not orthogonal to x\. Then we take v = \v'\ for 
generic A the restriction of (•, •) to ImC is non-degenerate; hence C is ample. 

Let k = 3 . We choose a basis {/i,/2,/3} of and {64,62,63,64} of U 
(maximal isotropic subspace of V) such that A has one of the following forms: 

Ai = fi® (ei A 62 -I- 63 A 64) + /2 O 1 , 

^2 = /i O 1 + /2 O (ei A 62) + h® (63 A 64), 

^3 = /i O (1 + ei A 62 A 63 A 64) + /2 O ei A 62 -I- /s O 6i A 63. 



Let 

B = fi® Xi + f2® X2 + h® X3. 

Let A = Ai. We need to show that there exist u,v G U such that the 
following element if ample: 

C = f I ® (xi + U + V A (ei A €2 + €3 A 64)) + f2® (X2 + v) + f3 ^ X3. 

If 3:3 ^ [/, then there exists v' G U such that {v, X3) ^ 0 and u' G U such that 
(ei A 62 -I- 63 A 64) Au' Av' ^ Q. We take v = Aw', u = Xu' . Then for generic A 
the image of C is 3 -dimensional and non-degenerate; hence C is ample. 

Suppose now that X3 G U. If X3 = 0 , then we finish the proof as in the 
case k = 2. 

Let X3 ^ 0 . If X2 ^ U, then there exist v' G U such that {x3,v' A (ei A 62 -I- 
63 A 64)) ^ 0 , X2 A v' ^ 0 . We take u = 0 , v = Xv'. Then for generic A the 
image of C is 3 -dimensional and non-degenerate; hence C is ample. 

Suppose now that X2 G U. Then we choose u and v such that u -I- w A (ei A 
62 + 63 A 64) = —xi - Then the image of C is isotropic. 

Let A = A2. We need to show that there exist v G U, u G (64,62), 
w G (63, 64) such that the following element is ample: 

C = fi®{xi + v) + f2®{x2 + v A (ei A 62) + u) + f3 ® (X3 + v A (63 A 64) -I- w). 

If xi ^ U, then there exists v' G U such that (v,xi) ^ 0 and u G (04,62) 
(or w G (63, 64)) such that u A v A 63 A 64 7^ 0 (or iw A w A 64 A 62 7^ 0 ) We take 

V = Xv', u = Xu', w = 0 (or w = Xw', u = 0 ). Then for generic A the image of 
C is 3 -dimensional and non-degenerate; hence C is ample. 

Suppose now that xi G U. Then we may suppose that xi = 0 after taking 

V = —xi- Now we are going to find u and w. 

If X3 is not perpendicular to (04,62) (resp. X2 is not perpendicular to 
(c3, 64)), then we take u' such that {u' , X3) ^ 0 , w' = 0 (resp. take w' such that 
(w',X2) yf 0 , u' = 0 ) and set u = Xu', w = Xw' . Then ImC is 2 -dimensional 
and non-degenerate, hence ample, for generic A. 

Let X3 T (64,62), X2 T (63,64). 

If (xs,X3) = 0 , then (x2,X3) = 0 , otherwise B is ample. Then (x2,X2) yf 0 , 
otherwise B is ample. Hence X2 is not perpendicular to (04,62) and we take 
w = 0 and v such that (x2,X2) + 2(x2,u) = 0. 
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Suppose, therefore, that (xsjXs) ^ 0, and, similarly, that (x2,X2) yf 0. 
It follows that X2 is not perpendicular to (61,62), X3 is not perpendicular to 
(63,64). We take u', w' such that (x2,u) yf 0, {x3,w') yf 0. We set u = Xu', 
w = Xw' . Then Im C is 2-dimensional and non-degenerate for generic A, hence 
C is ample for these values of A. 

Let A = A3. There exists x gV such that p(a;)(l-|-6i A62A63A64) = —xi. 
Therefore, without loss of generality we may assume that xi = 0. If B is ample, 
then there is nothing to prove. Otherwise, the restriction of a scalar form R 
to {x2,x^) has one-dimensional kernel. After a suitable change of basis we 
may assume that this kernel is spanned by X2- There exists x' such that 
p{x'){l -I- 61 A 62 A 63 A 64) is not orthogonal to X2- We take x = Ax'. Then 
for generic A the image of C is three-dimensional and non-degenerate with 
respect to R. 

(B) We choose a basis {/i, /2, /s} of and {ei, 62, 63, 64} of U (maximal 
isotropic subspace of V) such that A has one of the following forms: 

Ai = fi® (ei A 62 -I- 63 A 64) + /2 C) 1 , 

^2 = /i ® 1 + /2 O (ei A 62) + h® (63 A 64), 

^3 = /i ® (1 + ei A 62 A 63 A 64) + /2 ® ei A 62 -I- /3 0 ei A 63. 



Let 

S = (/2 A /s) (g) Xi -k (/l A /s) ®X 2 + (/i A f 2 ) ® X3. 

We take an isotropic subspace U' C V complementary to U and choose a 
basis {ci, 6^, 6|, 6|} of U' such that (c^, 6|) = Sij. 

Let A = A3. We take 

X = A(/3 ®ei + fi®e4 + f2®el + f3® 63 ). 

Then the image of D is 3-dimensional and non-degenerate, where D = 
Yli j{aiXvj)®p{xj)si. Therefore, for generic A, the image of C is 3-dimensional 
and non-degenerate, hence C is ample. 

Let A = A2. The same proof as above, but for 

X = A (/3 ®e*i + f2®el + fi® (61 + 62 + 63 + el)). 

Let A = Ai. The same proof as above, but for 

X = A(/3 ® 6 i + f 3 ®el + f2® 62). 

(C) If (s, s) yf 0, then p(V)s = S~ , otherwise, p(V)s = Uq, where Uq C S~ 
is a maximal isotropic subspace. It is clear now that we can find B such that 
Im (7 is isotropic. □ 
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3 Er and Eg : The Zoo 

We associate to each parabolic subgroup its coloured Dynkin diagram. To each 
graded component x > 0 we associate the coloured Dynkin diagram of the 
corresponding parabolic subgroup with vertices indexed as follows. The lattice 
Z is isomorphic to a sublattice in the root lattice spanned by simple roots 
marked white on the coloured Dynkin diagram. We write the corresponding 
coefficient of x near each white vertex. The representation of [f, f] on is 
irreducible and the Dynkin diagram of [[, 1] is equal to the black subdiagram 
of the coloured Dynkin diagram. We write the numerical labels of x near each 
black vertex (omitting zeroes). We shall pick several positive weights and call 
them twisting weights. All reduced positive weights of the form x + X) 
where x > 0 is not reduced and all /ii > 0 are twisting, are called rubbish 
weights. We shall draw a diagram with the set of vertices given by not reduced 
and rubbish weights and arrows indexed by twisting weights: an arrow /x 
has a tail xi nnd a head X 2 if and only if [g^uS/x] = Qx 2 - any e G n 
(resp. e G g/p~) we shall try to find an element u G U (resp. u G U~) 
such that all non-reduced graded components of the element Ad('u)e belong 
to ample orbits, except for at most one. Here U C P is the subgroup with 
a Lie algebra generated by all twisting weights components, and U~ C P~ 
is the subgroup with a Lie algebra generated by all graded components g^^, 
where — x is twisting. The standard strategy will be to decrease the number 
of non-reduced components by applying elements of the form expp, where p 
belongs to the graded component of some twisting weight. These ‘elementary 
transformations’ will be made in a special order, because they may change 
some other components as well. We shall use big Latin letters for non-reduced 
weights, small Latin letters for rubbish weights, and numbers for twisting 
weights. To save space, we shall use abbreviations of the form 

L^M. 

X.Y 

This means that if xz, C gi, is not ample (or not trivial if L is a reduced 
weight), then we can apply the element exp(p„), where G Qn, to make 
xm G Qm ample, and the reason for this is given in Proposition X.Y. Parabolic 
subgroups from the table will be subdivided into groups; in each group the 
proof is similar. 



Case lA 

This case includes parabolic subgroups with numbers 1 and 2. We shall con- 
sider the one with number 1. 
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Not reduced weights: 


Twisting weights: 


Rubbish weights: 


0 1111 


1110 0 


0 


2 11 


> 

• 

1 

0 

1 

• 

1 

0 

1 

• 


1 •— 0— 0— • 


a •— 0 — 0 — • 


^11 111 


^11 10 


2 


2 11 


B •— o— o— • 

™1 112^11 
C •— 0— o— • 


2 •— o— 0— • 

0 11% 

6 •— 0— 0— • 


b •— o— 0— • 



Diagram: 

B 

i3 ^ i3 ^ 
a 4 C 4 & 



1 2 

Consider the coadjoint case, x G n. Then A B, A C. If xa is ample, 
then B^C. 

l.B 

Adjoint case, x G 0/p~- b^^B, b^^C. Let Xb = 0. Then C=>B, 
■’ ’ l.A ’ l.A l.B ’ 

— 2 — 1 

C => A. If xc is ample, then B =i> A. 

l.B l.B 



Case IB 

This case includes parabolic subgroups with numbers 3, 4, 5, 6, 7, 8, 9. The 
proof is similar to the previous case (using Proposition l.A and l.B) but the 
combinatorics is more involved. To save space, we omit this proof and refer 
the reader to the even more complicated Case 5. 



Case 2A 



Parabolic subgroup with number 19. 



A ^ i J. J. 

A •— o— o— • 



2 11 
a •— o— o— • 



111 11 
B •— o— o— • 



A 1 7-> 1 

a 



■^o— • 1 •— o— •— ^o— • a •— o— •— 

Adjoint and coadjoint cases follow from Propositions 6. A, 6.B and l.A. 



Case 2B 

This case includes parabolic subgroups with numbers 20 and 21. We shall 
consider the one with number 20. 



.1 111 

A Q— o— • 



r- 



1 2 11 
B g— o— • 



o— • 



,1 10 

1 g— o— • 



1T* 



AA>B 

Both the adjoint and coadjoint cases follow from Proposition 6. A and Propo- 
sition 6.B. 
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3.1 Case 2C 



This case includes parabolic subgroups with numbers 22, 23, 24, 25, 26, 27. 
We shall consider the one with number 26. 



.1 11111 110 1 

A •— •—•— 0 —^— 0 — • 1 •— •—•— 0 —^— 0 — • a •- 

^ 1 2 ^ 11^1 1 *^ 11 , 

13 o— ^o— • 2 •— •—•—0—^—0— • b •- 

^ g Q 0 1^1 1 

O o— •— o— • 3 o— •— o— • 



■tr 



1 2 B 

J,3 ^ J.3 ^ 

O 1 1 ^ 1 7 

a ^ G ^ 0 



ir 



30 



1 2 

Coadjoint case, x € n. Then A=^B, A=>G. If xa is ample, then 
B^C. 

l.B 

Adjoint case, x G g/p”. Then h^^B and b^^C. Let Xb = 0. Then 



6.C 



6.C 

-1 



C =!■ B and C A. Let xc be ample. Then B A. 

l.B 6. A 6. A 



Case 2D 



This case includes parabolic subgroups with numbers 27, 28, 29. We shall 

consider the one with number 29. 

. 0 1 1111 10 
A •— o— o— • 1 •— o— o— • 

^111 ^ 11^11 *^11 
n •— o— o— • 2 •— o— o— • 

™11 1^2 ^01 ^11 

G •— o— o—« 3 •— o— o—« 

oi oo 

1 2 

Coadjoint case, x G n. Then A B, A C. If xa is ample, then 
B^C. 

e.B 

Adjoint case, x G Then c=^C and c^^B. Let Xc = 0. Then 

C B and C A. Let xc be ample. If xi, = 0, then B A. If xi, ^ 0 

6. A l.B 6.B 

then b=A B. 
l.A 



a •— o— 



'A 



1 2 
I— O— • 



b •— o— 



1 1 
I— o— • 



2 1 
C •— O— » 



A 

i3 

a 



L B 
^ C 



A b 



Case 2E 

This case includes parabolic subgroups with numbers 30, 31. We shall consider 
the one with number 31. 
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. oil 1 1110 

A •— o— •— o— • 1 •— o— •— o— • 

^11 1^1 ^11 1*^1 
13 •— o— •— o— • 2 •— o— •— o— • 

11121 ^ 011^1 
C •— o— •— o— • 6 •— o— •— o— • 



0 2 1 

a •— c^«— o— • 



T 



2 2 1 

b •— o— •— o— • 
2 1 

c •— o— •— o— • 



r 



d •— o— •— o— • 



B 

|3 ^ i3 ^ 
a 4 C 4 & 
^ i3 ^ i3 



1 2 

Coadjoint case, x G n. Then A=^ B and A=^C. If xa is ample, then 
B^C. 

e.A 

Adjoint case, x G q/P~ ■ If Xc 0 or Xb ^ 0, then we first apply exp(p_ 3 ) 
to make Xb ^ 0 if necessary. Then b=A' B and If Xc,Xb = 0 then 

d=^C and B A. If Xc,Xb,Xd = 0 then C B and C A. If xc is 

l.A l.B e.B 6.B 

ample, then B =4> A. 

l.B 



Case 3 

This case includes parabolic subgroups with numbers 32, 33. We shall consider 
the one with number 33. 

,1 111 1 1 13 

A o— • 1 o— • a o— • 

01 oo ii A^B^a 

T3 1 2 1 

a o— • 

The adjoint and coadjoint cases follow from Proposition 6.D and Proposi- 
tion 6.E. 



Case 4A 

In this case we study the parabolic subgroup number 34. 

.Ill 0 T^ll 1 ,0 11 

A 9— 0—9— ^9—0 a 9— 0—9— 9— 9-0 1 9— 0—9— 9— 9-0 

I h I A^B 

Both the adjoint and coadjoint cases follow from Proposition 7. A. 

Case 4B 

This case includes parabolic subgroups with numbers 35, 36. We shall consider 
the one with number 36. 
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.1111 0 , 0 0 
A •— o— o— o 1 •— o— o— •— 



11 112 0 
•— o a •— 0 — 0 — o 



B 



„111 1„01 1,112 2 „ „ 

B •— 0—0— •—•—•— o 2 •— 0—0— •—•—•— o b •— 0—0— •—•—•— o J.3 Xj 

il il i 1 1 

112 11011 0 a^L/^0 

C •— o— o— o 3 •— o— o— o 

Easy digram-chasing shows that everything follows from Propositions 7. A 
and l.A. 



Case 4C 



This case includes the parabolic subgroup with number 37. 



.Ill 0„11 1,12 2 

A •— *—0— •—•—•— o 2 •— *—0— •—•—•— o b •— *—0— o 

1 il 1 4 2 



A A B 

„11 0 31 2 „ „ 

B •— *— 0 — •—•—•— o 3 •— *— 0 — •—•—•— o c •— *— 0 — o \ \ 

il i i 1 Cl 1 

12 11 3 1 0 , — >(_/ — >0 

C •— *— 0 — •—•—•— O 12 0 d •— *— 0 — •—•—•— O I o \2 I o 

I a •— *— 0 — •—•—•— O \i3\4,3 

• 14 2 (] r 

, oil e •— *— 0 — o 

1 ,_^o-*-.-*-o I ^ |3 



The coadjoint case follows from Proposition 7. A and Proposition 7.B. The 
adjoint case easily follows from Proposition 7. A, Proposition 7.B, Proposition 
4. A, and Proposition 7.C. 

Case 5A 

This case contains parabolic subgroup with number 10. 



oil 1 „ii 1 1 



A •— o— •— o— • 2 •— o— •— o— • b m—o—u—q—u—i 



T3 1 1 1 1 

B 9 — 0 — 9 — 0 — 9— 9 



rr 

1 1 

IT' 



1112 1 
C •— o— • 

1110 
1 •— o— • 



^0111 213 on 

3 c 9-o-9-n-9-9 |3 ^ |3 ^ 



T- 



cl ^ ^ 3 

d •— o— •— o— • 



2 4 1 

e •— o— •— 0 — • 



T- 

3 

IT* 

3 

T- 

4 1 

r" 



A A B 



a 4 C 4 & 
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Consider the coadjoint case, let x G n. Then A B, A C. If xa is 

ample, then B C. 

5 . A 

Adjoint case, x G g/p~. Suppose first that either Xb, Xc, or Xe is not trivial. 

Applying exp(p_ 3 ) if necessary, we may assume that xt yf 0. Then b^^B, 

i.A 
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Let Xb = Xc = Xe = 0. Then d=^C, B =k> A. Let Xd = 0. Then 

4. A l.A l.B 

C B, C A. Let Xc be ample, then B A. 

5. A l.B l.B 

Case 5B 

This case includes parabolic subgroups with numbers 11, 12, 13. We shall 
consider the one with number 11. 
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A^j B^i C^l D^m g^n h^o 
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A^l C^n a^o 
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12 4 

Consider the coadioint case, x &n. Then A B, A C, A D. Sup- 

’ l.B ’ 5. ,4 ’ 4.B ^ 

3 5 6 

pose that xa is ample, then B C, B D. Let xs be ample, then C D. 

5.A i.B i.B 

Adjoint case, x G o/p~. Then n=^D, n=^C, n=M- B. Let x„ = 0, then 

l.A l.A l.A 

0 =^ D, o=f C, 0 =^ A. Let Xo = 0, x; 0 or Xm ^ 0 (in the latter case we 



l.A 



l.A 



l.A 



apply exp(p_ 6 ) if necessary to make xi ^ 0). Then l=^C, l=^A, l=^B. 

4. A 5.C 5.C 

Let xi = Xm = 0, then i D, i C, i B. Let Xi = 0, then j D, 

l.A 5.C 4.A l.A 

j C, j A. Let Xj = 0, then k =l> C, k A, k =M- B. Let Xfc = 0, then 
g=^C, g=^B, g=^A. Let x„ = 0, then h=^C, h=^A, h=^B. Let 

l.A l.A 4.B ^ l.A l.A 4.B 

Xh = 0, Xe yf 0. Applying exp(p_e) if necessary, we also make Xd = 0. Then 
e ^ e ^ B, C ^ A, Let Xe = 0, then D C, D B, D A. Let 

4.A 1.^ 5.^ 4.B 4.B 4.B 



Xd be ample, then d=>B. Let Xd = 0, then C A, C^^B. Let 

4.A 4.A 5. A 5.^ 

xn be ample. Then 

l.B 



3.2 Case 5C 

This case includes parabolic subgroups with numbers 14, 15. We shall consider 
the one with number 14. 
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Consider the coadjoint case, let x C n. Then A^^D. 



A.B 



l.B 



4 ^ 



3 5 6 

Let XA be ample, then B^^C, B=^D. Let xb be ample, then C^^D. 

i.B i.B 5. A 

Adjoint case, x G fl/p'. Then n=^ D, n=^ B, n=^C. Let x„ = 0, then 

■’ > i.A ’ l.A ’ 1. A n , 

m D, m A, m C. Let Xm = 0, then o =1 D, o B, o =1 A. Let 



4.A 



4.A 



4.A 



l.A 



l.A 



l.A 



Xo = 0, then i=^C, i=^A. Let Xi = 0, then k=^D, k=^B, 

l.A l.A 4.B 4.A l.A 

k =} A. Let Xk = 0, then j D, j A, j C. Let x, = 0. If x„ ^ 0, 

then by Proposition 5.E, we can apply exp(p_ 3 ) to force Xe to have rank 

2. Afterwards, e=k>D, e=^A. Let Xo = 0, then e=k'D, e=l>C', 

5.C l.A l.C g ’ 4 ^ 

e =4 B. Let Xg = 0, then h D, h =4 C; if x^ yf 0 then d =4 B, if x^ = 0 

l.A l.A l.A l.A 

then B A. Let Xh = 0, then D =4 C, D =4 B, D A. Let xd be ample, 

4.B n , 5.A ’ 4.B ’ 5.A ^ ’ 

2 3 2 

then d^^C, d^^ B. Let Xd = 0, then C =4> B, C A. Let xn be ample, 

l.A l.A 4.B l.B 

then B =4 A. 

4.B 



Case 5D 



In this case we study parabolic subgroup with number 16. 
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12 4 

Coadioint case, x G n. Then A^> B, A^^C, A=> D. Let xa be ample. 

l.B i.B 5.A 

Then B C, B D. Let xs be ample. Then C D. 

4.B 5. A 4.B 




Hermitian Characteristics Of Nilpotent Elements 203 



Adioint case, a; e g/p . Then n=^ D, n=^-C, n=^ B. Let = 0. Then 

i.A ’ i.A ’ i.A 

0 D, o C, o A. Let Xo = 0. Then m D, m A, m B. Let 

l.yt I.A I.A A.A i.A i.A 

Xm = 0. Then l=^D, l=^C, l=^A. Let xi = 0. Then i^^D, i=^B, 

i.A I.A 5.C I.A I.A 

— in — 11 

1 A. Let Xi = 0. Then j =i> D, j A, j => B. Let x,- = 0, x^ ^ 0. We 

i.B I.A ’ I.A ’ i.B ^ ^ 

2 4 7 

can apply exp(p_ 3 ) to force Xg to have rank 2, then g D, g C, g A. 

Let Xk = 0, then g D, g ^4 C, g B. Let x„ = 0, then h D, h C, 

h =l> A. Let Xh = 0, Xe yf 0. Applying exp(p_g) if necessary, we make Xd = 0, 
i.A 

then e^D, e^B, C^A.Let Xe = 0. Then D^C,DA^B,DA^A. 

i.A i.A i.B i.B 5.A 5. A 

Suppose Xd is ample. Then d^^C, d^^B. Let Xd = 0. Then C^^B, 

I.A I.A i.B 

— 2 — 1 

C A. Let xn be ample, then B A. 

i.B I.B 



Case 5E 

This case consists of parabolic subgroups with numbers 17 and 18. We shall 
consider the one with number 17. 
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12 4 

Consider the coadioint case, let x G n. Then A=^B, A=^C, A=>D. 

■> ’ A.B i.B A.B 

3 5 

Let XA be ample. Then B^^C, B=^D. Suppose that xb is also ample. 

I.B 5. A 

Then C=Ud. 

5. A 

Adjoint case, let x G Then l^^B, Let xi = 0. 

A. A A. A A. A 

Then i =A D, i C, i =l> B. Let Xi = 0. Then j =A D, j B, j C.. 
Let Xj = 0, Xg ^0. Then we first apply exp(p_ 3 ) and exp(p_ 5 ) to make Xe = 

— 2 —4 —1 

Xd = 0, then g=A^D, g^^C, B=^A. Let x„ = 0, Xg A 0. First, we apply 

l.A l.A A.B 

exp(p_6) to make Xd = 0, then e=^L>, e=^B, C A. Let Xg = 0. Then 

l.A l.A A.B 

d^C, d^B, D^A. Let Xd = 0. Then h^D, h^C, B ^ A. Let 

5.C 5.C A.B A. A A. A A.B 

Xh = 0. Then D =l> C, D =A B, D A. Let xd be ample. Then C =A B, 

5.A 5.A A.B I.B 

— 2 —1 

C => A. Let xc be ample, then B => A. 

A.B A.B 
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Introduction 

Consider the vector space of square matrices of order r and the corresponding 
projective space P = P’’ The points of P are in a one-to-one correspon- 
dence with the square matrices modulo multiplication by a nonzero constant. 
Consider the Segre subvariety X = P’'~i x P'’”! c P corresponding to the 
matrices of rank one and a filtration 

X cx^ c-- - c x'^-^ c a:’' = p, 

where, for 1 < z < r, AT* denotes the z-th join of X with itself. We recall that 
by definition AT* (also called the (z — l)-st secant variety of AT) is the closure 
of the subvariety of P swept out by the linear spans of general collections of z 
points of X. Thus in our case X® corresponds to the cone of matrices whose 
rank does not exceed z. In other words, if M is a matrix and Zm G P is the 
corresponding point, then rkM = rkx Zm, where for z G P 

rkx z = min {i \ z G X®}. 

It is clear that X®"”^ C P is the hypersurface of degree r defined by van- 
ishing of determinant, which gives a method to define determinant (up to 
multiplication by a nonzero constant) in purely geometric terms. 

Alternatively, one can consider the dual variety X* C P* whose points 
correspond to hyperplanes tangent to X. It is not hard to see that in the case 

* Research partially supported by RFBR grant 01-01-00803 
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when X = x the variety X* is a hypersurface of degree r in the 
dual space P* which is also defined by vanishing of determinant. This gives 
another way to define determinant in geometric terms. 

It is tempting to study similar notions and interrelations between them for 
arbitrary projective varieties. The idea is to associate, in a natural way, to any 
projective variety X a hypersurface (or at least a variety of small codimen- 
sion) from which one should be able to reconstruct X (or at least some 
of its essential features). Then geometric and numerical invariants of 
would yield important information on X itself. On the other hand, varieties 
of low codimension (and particularly hypersurfaces) are easier to study from 
algebraic and analytic points of view. A classical way to realize this idea is to 
consider generic projections, and, indeed, invariants of multiple loci of such 
projections provide a useful tool for the study of projective varieties. How- 
ever, generic projections are not canonical, and they preserve the dimension 
of variety while changing the dimension of the ambient linear space. In con- 
trast to that, the above two constructions of hypersurfaces associated to the 
Segre variety X = P’'~i x P’’~i are well defined and preserve the dimension of 
the ambient space (we recall that X®'®® = X'^~^ for the first construction and 
Xass _ second one). These constructions generalize to arbitrary 

projective varieties, and in the present paper we study these generalizations 
of determinant called respectively join determinant and discriminant. In par- 
ticular, we give lower bounds for the degree of associated varieties in these 
two cases. 

As we already observed, in the above examples the degree of associated 
hypersurface is equal to the order of matrix, and it turns out that, if we de- 
fine the order of an arbitrary nondegenerate variety X C by the formula 
ordX = rkx z, where 2 G P^ is a general point (cf. Definition 1.3), then 
the degree of associated variety (or determinant) in the above two senses is 
at least ordA, so that ordA is the lowest possible value of degree of deter- 
minant. Furthermore, for the varieties on the boundary associated variety is 
a hypersurface, and, in the case of discriminant, we give a complete classifica- 
tion of varieties for which deg A* = ord A. It seems that the lower the degree 
of “determinant” the more the points of the ambient space resemble matrices; 
in particular, the corresponding varieties tend to be homogeneous, which can 
be viewed as a generalization of multiplicativity of matrices. 

Even though the notion of order of projective variety is quite natural, 
it is not widely used. We also give another lower bound for the degree of 
discriminant in terms of dimension and codimension. This bound is also sharp 
and, rather surprisingly, the varieties on the boundary seem to be the same 
as for the bound in terms of order. This second approach is based on a study 
of Hessian matrices of homogeneous polynomials, and, although this topic 
apparently pertains to pure algebra, it has numerous classical and modern 
links with fields ranging from differential equations and differential geometry 
to approximation theory and mathematical physics. 
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The paper is organized as follows. Section 1 is devoted to join determi- 
nants. We obtain a lower bound for their degree in terms of order and consider 
numerous examples. In section 2 we study dual varieties (discriminants) and 
obtain a lower bound for their degree (called codegree) in terms of order. We 
also consider various examples and classify varieties on the boundary. To put 
the problem in a proper perspective, in section 3 (which is of an expository 
nature) we collect various known results on varieties of small degree and code- 
gree. In section 4 we study Jacobian linear systems and Hessian matrices. As 
an application, we obtain a lower bound for codegree in terms of dimension 
and codimension and consider varieties for which this bound is sharp. 

To avoid unnecessary complications, throughout the note we deal with 
algebraic varieties over the field C of complex numbers. 

Acknowledgements. I discussed the contents of the present paper, particularly that 
of Section 4, with many mathematicians. I am especially grateful to C. Ciliberto, 
J.-M. Hwang, J. Landsberg, L. Manivel, Ch. Peskine, F. Russo, E. Tevelev and 
M. Zaidenberg for useful comments. This paper is a considerably reworked and 
expanded version of my talk at the conference in Vienna, and I am grateful to 
V. L. Popov who patiently but hrmly managed the process of organizing the con- 
ference as well as publishing its proceedings and who insightfully observed the con- 
nection between my work and the theory of transformation groups (this connection 
with homogeneous and prehomogeneous varieties is not quite evident in the present 
paper, but will hopefully be clarified later on). Large portions of the present paper 
were written during my stay at IRMA in Strasbourg, and I am grateful to CNRS 
and particularly to O. Debarre for inviting me there. 



1 Join Determinants 

Let X C P^, dim A = n be a nondegenerate projective variety (i.e., X is not 
contained in a hyperplane) . 

For an integer fc > 1 we put 

X^ = 

{{xi, . . . ,Xk,u) e X X ■■■ X X^ xP^ I dim(xi, . . . ,Xk) = k - l,u £ {xi, . . .,Xk)}, 
k 

where, for a subset A C P^, we denote by (A) the linear span of A in P'^ and 
bar denotes projective closure. We denote by the projection of X^ to P'^. 

Definition 1.1. The variety X^ = <p^{X^) is called the k-th join of X with 
itself 

It is clear that if P^ = P(R), where V is a vector space of dimension 
N + 1, and Cx C R is the cone corresponding to X, then A* is the variety 
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corresponding to the cone Cx + • • • + Cx- Furthermore, is the join of X 

' V ' 

k 

with X^~^ and X^^^ = X^ if and only if X^ = P^. 

It is often necessary to compute tangent spaces to joins. 

Proposition 1.2. (Terracini lemma) 

(a) Let x\, . . . ,Xk & X , and let u G (xi , . . . ,Xk) C X^ . Then 

Txi=,u 3 {Tx,xi,- ■ ■ ,Tx,Xk), 

where Tx,x (resp. Tx'=,«) is the tangent space to the variety X at the point 
X (resp. to the variety X^ at the point u). 

(b) If xi, , Xk is a general collection of points of X, and u is a general point 
of the linear subspace {xi, . . . , Xk), then 

Tx’^.u = {Tx.xi,- ■ -,Tx,Xk)- 

Proof. This is a special case of [Z2, Chapter V, Proposition 1.4]. 

Definition 1.3. For a point 2 G P^ we put rkx 2 = min{fc | z G X^}. The 
number rkx is called the rank of z with respect to the variety X. 

The number ordX = min {k \ X^ = P^^} = maxfrkx z\ is called the order 

zSP”’ 

of the variety X. 

The difference corkx ^ = ord X — rk z is called the corank of z with respect 
to the variety X. 

Thus 1 < rkx -z < ordX, rkx a; = 1 if and only if a: G X, rkx 2 ; = ord X 
for a general point z G P^ (z ^ and we get a strictly ascending 

filtration 

X C . . . C = X-^ C ^ordX ^ pJV_ 

Definition 1.4. The filtration (1.3.1) is called the rank filtration, and the 
variety X'' = the join determinant of X. 

The number codimpiv X'' — 1 is called the join defect of X and is denoted 
by jodef X; it is clear that 0 < jodef X < dimX = n. 

The degree degX'^ of the join determinant is called the jodegree of X and 
is denoted by jodegX. 

Examples 1.5. 1) If X = P’’~i x P’’~i c P, then one gets the standard 
notions of order and rank discussed above. In particular, ordX = r, X"^ 
is the locus of degenerate matrices, jodegX = ordX, and X'^ is defined 
by vanishing of determinant. 

2) If X = P“~i X P^“i C a < b and zm G P“^~i is the point cor- 

responding to an (a x 6)-matrix M, then rk zm = rkM. Furthermore, 
ordX = a and codim po6-i X'^ = b — a+ 1. By a formula due to Giambelli, 
jodegX = (a_i)i(fcTa+i)! (cf- [Ful, 14.4.14]), which is much larger than 
a = ordX if b ^ a. 
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3) Let X = X X C P^, so that the ambient P^ can be interpreted as 
the space of cubic 2-matrices up to multiplication by a nonzero constant. 
Then X'’ = X, ordX = 2 and jodegX = degX = 6. 

4) Let C = Um(P^) C P™ be a rational normal curve. The points of the ambi- 
ent space P™ can be interpreted as binary forms of degree m modulo mul- 
tiplication by a nonzero constant. Our definition of rank again coincides 
with the usual definition for binary forms. Furthermore, ordC = [ ] , 
where brackets denote integral part, 



codim pm c-^ 




m = 0 (mod 2), 
TO = 1 (mod 2) 



and 



jodeg C 



ordC= [^] , 



TO = 0 (mod 2), 
TO = 1 (mod 2) 



(this can be easily computed basing on Sylvester’s theory of binary forms; 
cf. [Syl]). Thus the jodegree of C is equal to the order of C for to even 
and is much larger than the order for to odd. 

5) Let X = U 2 (]P”^~^) C P 2 ^ be the Veronese variety. The points of 

the ambient linear space correspond to symmetric matrices of order r, 

r(r+l) _ 

and if M is a matrix and Zm € P 2 ^ is the corresponding point, 

then rkzM = rkM. Here the variety X is a (special) linear section of the 
Segre variety from 1), and, as in the case 1), ordX = r and X'^ is the 
hypersurface of degree r defined by vanishing of determinant. 

6) Let X = G{r — 1, 1) C p( 2 )~i be the Grassmann variety of lines in P’’“^. 
Then n = dimX = 2(r — 2) and the points of p( 2 )“^ correspond to skew- 



symmetric matrices of order r. If M is such a matrix and zm G ^ is 
the corresponding point, then rk zm is equal to i rk M (i.e., to the pfaffian 



codim 






x-' = 



and 



. jordX = 

jodeg X= I l^r+l^ 



[?] 


+ 


1, 




r = 


0 


(mod 


2), 


r = 


1 


(mod 


2) 


r = 


E 0 


(mod 


2), 


r = 


E 1 


(mod 


2) 



(cf. [HT]). Thus the jodegree of X is equal to ordX for r even and is much 
larger than ordX for r odd. In this case X is a (special) linear section 
of the Segre variety from 1), and X"^ corresponds to the skew-symmetric 
matrices whose rank is less than maximal. In particular, for r even the 
hypersurface is defined by vanishing of Pfaffian. 
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Theorem 1.6. Let X C P'^ be a nondegenerate variety. Then jodegX > 
ordX+jodef X > ordX. In particular, the jodegree is not less than the order, 
and equality is possible only if X'^ is a hypersurface. 

Sketch of proof. Let {xi, . . . , Xordx} be a general collection of points of 
X. By the definition of ordX, the (ordX — l)-dimensional linear space 
(xi, . . . , a;ordx) does not lie in X'', but contains ordX linear subspaces of 
the form {xi^, . . . dim (xi^ , . . . , = ordX - 2, < • • • < 

*ordX-i- Thus a general line I C (xi, . . . ,Xordx) is not contained in X'^, but 
meets it in at least ordX points. Furthermore, adding points, it is easy to 
construct a linear subspace L C P'^, dimi = codimpiv = jodef X + 1 
which is not contained in X'^ , but meets it in at least ordX + jodef X points. 
Thus degX"^ > ordX + jodef X, and our claim follows. □ 

Remarks 1 . 7. (i) The same argument shows that 

deg X^ >k + codimpN X^ (1-7 .1) 

usual bound for degree; cf. Theorem 3.4, (i)). 

(ii) For 1 < A: < ordX, the variety X^ is not contained in a hypersurface 
of degree k or less. In fact, suppose that X^ C W, where W C P^ is 
a hypersurface. Arguing as in the proof of Theorem 1.6, we see that, 
for a general collection {xi, . . . , x^+i} of points of X, the intersection 
(xi, . . . , Xk+i) n X^ contains fc + 1 hyperplanes of the form (xi ^ , . . . , Xi,.}, 
i\ < ■ ■ ■ < ik. Then either deg W = deg IF D (xi, . . . , x^+i) > A: + 1 or 
W D (xi, ... , Xk+i). In the first case we are done, and in the second case 
W D X^+\ so that we arrive at a contradiction by induction. 

(iii) Arguing as in the proof of Theorem 1.6, one can show that, for an arbitrary 
point z G X^, one has 

mult 2 > A: — rkz + 1, (1-7.2) 

where multz A* denotes the multiplicity of A^ at the point z (compare 
with the bound for multiplicity of points of dual varieties given in Section 2 
(cf. (2.11.1) ). We observe that, for z G X, (iii) implies (i). For k = ord A — 
1 the inequality (1.7.2) assumes the form 

multz A'^ > corkx z € X"^ . (1.7.3) 

This bound (which should be compared with the bound for multiplicity 
in Proposition 2.9) can be used to give a different proof of Theorem 1.6 
(compare with the use of Proposition 2.8 in the proof of Theorem 2.7 
below). 

(iv) Since any variety of degree d and codimension e is contained in a hyper- 
surface of degree d — e -I- 1 (and is in fact a set theoretic intersection of 
such hypersurfaces; to see this it suffices to project the variety from the 
linear span of a general collection of e — 1 points on it and take the cone 
over the image), (ii) also yields Theorem 1.6 and, more generally, (i). 
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(v) Theorem 1.6 and the remarks thereafter were known to the author for 
many years. Proofs of some special cases can also be found in [Ge, Lec- 
ture 7] and [C-J]. 

Theorem 1.6 gives a nice bound for jodegree in terms of order, but the 
notion of order might seem a bit unusual. So, it is desirable to give a bound in 
more usual terms, such as dimension and codimension. One has the following 
lower bound for order. 

Proposition 1.8. Let X" C be a nondegenerate variety. Then ordX > 
N — jodef X N +1 

h 1 > . 

n -I- 1 n + 1 

Proof. In fact, for each natural k, dimX* < dimX^ = kn+k—1. In particular, 
N — jodef X — 1 = dim X'^ < (ordX — l)(n -I- 1) — 1, 
which yields the proposition. □ 

In the case when C C P^ is a curve, one always has ord C = , where 

brackets denote integral part, dimC* = 2z — 1, 1 < i < ordC — 1 and 



jodef C 



0, N = 0 (mod 2), 

1, N = 1 (mod 2) 



(cf., e.g., [Z2, chapter V, Example 1.6]). Thus the bound for order given in 
Proposition 1.8 is sharp in this case. 

Theorem 1.9. Let C C P^ he a nondegenerate curve. Then ordC = 
and jodeg C > ord C. Furthermore, jodeg C = ord C if and only if N is even 
and C is a rational normal curve (cf. Example 1.5,4). 

Sketch of proof . The first claim follows from Theorem 1.6 in view of the com- 
putation of codim pm C'’ made above. 

From Proposition 1.2 and the trisecant lemma (cf. [HR, 2.5], [Ha, Chap- 
ter IV, §3] or [Mum, §7B]) it is easy to deduce that the map ^ C* is 

birational for i < ord C. Suppose that jodeg C = ord C. Then, as we already 
observed, N = 2k, where fc is a natural number, and ordC = = A: -I- 1. 

From Theorem 1.6 and Remark 1.7 it follows that mult a, C'' > k for each 
point X G C. Thus, projecting C from the point x to we get a curve 

C C such that degC' = degC — 1, ordC' = k, and the projection 

C^ — ^ C'^ = is birational. Hence the map p' ^ : C ^ ^ C ^ = p^^-i 

is also birational. Thus to prove our claim it suffices to show that any curve 
C' C p2fc-i with this property is a normal rational curve. 

To this end, we take a general point z G C'^~^ and consider the projection 
TTz '. C ^ P^ with center at the linear subspace Tc^k-i ^. From Proposition 1.2 
it easily follows that deg = deg C' — 2{k — 1), and so it suffices to verify that 
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the map is an isomorphism. If this were not so, then the map tt^ would be 
ramified and there would exist a point x G C such that Tq^x H T^ik-i ^ yf 0. 
By the Terracini lemma, the line (x, z) lies in the branch locus of the map 
k . Qf k ^ p 2 fc-i^ Varying z in it is easy to see that the branch locus 

is a hypersurface in The proof is completed by recalling that is 

birational, and so in our case the branch locus has codimension at least two 
(cf. also [C-J]). □ 

For higher dimensions there is little chance to obtain a classification of 
varieties for which the inequality in Theorem 1.6 turns into equality (some 
of these varieties were listed in Examples 1.5). One of the reasons is that 
variety X is not uniquely determined by its join determinant . Here follows 
a typical example of this phenomenon. 

Example 1.10. Let U 2 (]P^) C P® C P® be the Veronese surface (cf. Ex- 
ample 1.5,5) for r = 3), let j/ G P® be a point, let Y C P® be the 
cone over U 2 (P^) with vertex y, and let X be the intersection of Y with 
a general hypersurface of degree d > 2. Then X C Y C P® is a non- 
degenerate surface, dimV^ = 5 = dimV^, and therefore X'^ = Y'^ and 
jodegV = ordV = ordV = jodeg V = 3. 

Thus a lot of different surfaces have the same order and the same join 
determinant. 

Remark 1.11. Of course, one can construct similar examples starting from 
other varieties whose higher self-joins have dimension smaller than expected 
(cf., e.g.. Examples 1.5). Thus, in the case of Segre variety Y = P’'~^ x P’’~i 
or Grassmann variety Y = G(r — 1,1) with r even (Examples 1.5, 1), 6)) 
any general subvariety X gY oi sufficiently small codimension has the same 
order and join determinant as Y . This leads to the notion of constrained 
varieties (cf. [A]) which deserves to be studied in detail. It should be possible 
to classify “maximal” (nonconstrained) varieties with jodegree equal to order; 
then arbitrary varieties with this property should be (constrained) subvarieties 
of the maximal ones. 

It should be noted however that even the lists of nonconstrained varieties 
of a fixed jodegree are rather big. For example, in view of the above observa- 
tion, the list of nonconstrained varieties of jodegree three is much longer than 
the corresponding lists of varieties of degree three (cf. Theorem 3.3, (iii)) or 
codegree three (cf. Theorem 3.5, (iii)). Still, imposing additional natural con- 
ditions, such as inextensibility, can help to make this list shorter (cf. also 
Remark 2.13, (ii) ). 

Remark 1.12. A nice series of examples of varieties of small jodegree illus- 
trating Remark 1.11 can be constructed as follows. Let Y C P^ be a nonde- 
generate variety, and let X = V 2 {Y) be the quadratic Veronese reembedding 
of Y. Then ord A > TV -|- 1 (cf. [Z3, Theorem 2.7]), and in [Z3] we construct 
numerous examples of varieties for which ord X = N+1 and X^ = n (A), 
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where Z = ti 2 (P'^) and {X) is the linear span of X. Since is a hypersurface 
of degree fV + 1, for such a variety one has jodegX = ordX, so that X is on 
the boundary of Theorem 1.6. 

Example 1.13. A well known example highlighting Remark 1.12 is due to 
Clebsch (cf. [Cl] and [Z3, Remark 6.2]). Let X = U4(P^) C P^"^. Then 
JodegA = ordA = 6, and the join determinant of A is the locus of quar- 
tics representable as a sum of at most five bisquares. 

2 Discriminants 

Let A C P'^ be a projective variety. Consider the subvariety 

Vx = {{x,a)\x& SmA,L„ D Tx,x} C A x P^*, 

where SmA denotes the subset of nonsingular points of A, C P^ is the 
hyperplane corresponding to a point a G Tx,x is the (embedded) tangent 
space to A at x, and bar denotes the Zariski closure. Let p : Vx X and 
7T : Vx — *■ P^* be the projections onto the two factors. 

Definition 2.1. Vx is called the conormal variety of A, and A* = tt{Vx) C 

pN* 

is called the dual variety or the discriminant of A. 

In most cases one can assume that A is nondegenerate because if A C L, 
where L C P^ is a linear subspace and A£ is the dual of A viewed as a sub- 
variety of L, then A* is the cone over A£ with vertex at the linear subspace 
-^L C P^* of all the hyperplanes in P^ passing through L. Conversely, if 
A C P^ is a cone with vertex L over a variety Y C P'^, M = N — dim L — 1, 
then A* = A* C P^* = ^Lc P^*. 

Unlike join determinant, discriminant allows to reconstruct the original 
variety, viz. one has the following 

Theorem 2.2. A** = A, i.e., projective varieties are reflexive with respect 
to the notion of duality introduced in Definition 2.1. 

We refer to [Tev] for this and other results on dual varieties that are used in 
this paper. 

Typically, for a nonsingular variety A, the dual variety is a hypersurface (in 
view of Theorem 2.2, one cannot expect this to be true for arbitrary varieties). 

Definition 2.3. The number codimpiv. A* — 1 is called the (dual) defect of 
A and is denoted by def A. 

The degree of the dual variety A* is called the codegree or (if def A = 0) 
class of A and is denoted by codeg A (thus codegA = deg A*). 
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Proposition 2.4. Let X C P'^ be a projective variety, let L C P^ be a general 
linear subspace, L(1X = 0, let ttl : P'^'^ — + P^, M = N — dimL — 1 be the 
projection with center at L, and let Y = ttl{X) C P^. Then Y* = X* n ^L, 
where -^L C P'^* parameterizes the hyperplanes in P^ passing through L and 
thus is naturally isomorphic to P^*. 

In the case when def X > 0 one can apply Proposition 2.4 (combined with 
Theorem 2.2) to X* to show that the dual of a general linear section of X is 
a general projection of X*. This yields a reduction to the case of varieties of 
defect zero (of course, the degree of X* is stable under general projections). 

The Terracini lemma 1.2 yields useful information on the structure of X*, 
viz. one gets a descending filtration 

^ (^2)* ^ ^ (^ordX-l)* (-2.4.1) 

corresponding to the ascending filtration!(1.3.1) (cf. Proposition 4.2 below for 
a more precise statement). 

Definition 2.5. The filtration (2.4.1) is called the corank filtration. 

Consider the varieties described in Examples 1.5 from the point of view of 
structure of their duals. 

Examples 2.6. 1) If X = P’’~i x P’'~i c P, then X* is the hypersurface 
defined by vanishing of determinant. Hence codegX = r = jodegX = 
ordX. In this case (2.4.1) is just the filtration by the corank of matrix. 

2) li X = P“~i X P^“i C a < b, then X* corresponds to matrices of 

rank smaller than a in the dual space, def X = b — a, X* is projectively 
isomorphic to X'^ and, as we saw in Example 1.5,2), ordX = a and 
codegX = (a_i)i(fcTa+i)! Pul, 14.4.14]), which is larger than a = 
ordX if 6 yf a. Here again (2.4.1) is the filtration by corank. 

3) Let X = P^ X P^ X P^ C P"^ (cubic (2 x 2 x 2)-matrices). Then it is easy 

to see that def X = 0 and X* is a hypersurface of degree four (we recall 
that jodegX = 6; cf. Example 1.5,3)). The discriminant (or hyperde- 
terminant) in this case was first computed by Cayley [Caj. The variety 
X is a special case of symmetric Legendrean varieties all of which have 
codegree four (cf. [Mu], [LM] and Remark 3.6 below). More generally, if 
X = P"i X ••• X P”*" C ni < ri 2 < • • • < Uk, then it 

is easy to see that def X = max {uk — 0}> and one can use tools 

from combinatorics to compute the codegree (cf. [GKZ, Chapter 14B] for 
the case of def X = 0), which, in our opinion, does not make much sense; 
anyhow, the codegree is very large. 

4) Let C = Um(P^) C P™ be a rational normal curve. Then C* is the hyper- 
surface in P*”* swept out by the osculating (m — 2)-spaces to the curve in 
P™* parameterizing the osculating hyperplanes to C and defined by van- 
ishing of discriminant of binary form. Thus, for m > 2, codeg C = 2m— 2 is 
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larger than ordC = , but (2.4.1) is again the filtration by the corank 

of binary form. It should be noted that in this case codeg C > jodeg C for 
m > 2 even while codeg C < jodeg C for m > 3 odd (cf. Example 1.5, 4) ). 

5) If X = W 2 (P’’“^) C P 2 ^ ^ is a Veronese variety, then X* is the hyper- 
surface of degenerate matrices in the dual space of symmetric matrices of 
order r defined by vanishing of determinant; in particular, (2.4.1) is the fil- 
tration by corank and codeg X = ord X. Furthermore, the dual variety X* 
is projectively isomorphic to X^ and, in particular, codeg X = jodeg X. 

6) Let X = G{r — 1, 1) C p( 2 )~i be the Grassmann variety of lines in P’’“^. 
Then 

defX=|“' 

1^2, r = 1 (mod 2), 

and (2.4.1) is the filtration by pfaffian corank. Furthermore, 



codeg X 



ord X = ^, r = 0 (mod 2) , 
^=1 (mod 2) 



(cf. [HT]). The dual variety corresponds to the skew-symmetric matrices 
whose rank is less than maximal. In particular, if r is even, then the 
hypersurface X* is defined by vanishing of Pfaffian. Thus the codegree is 
equal to ordX if r is even and is much larger than ordX if r is odd. We 
observe that also in this case X* is projectively isomorphic to X"^ and, in 
particular, codeg X = jodeg X. 



The following result is an analogue of Theorem 1.6 for codegree. 

Theorem 2.7. Let X^cP^ be a nondegenerate variety. Then d*= codeg X> 
ordX. Furthermore, if X is not a cone, then d* > ordX -|- def X > ordX. 
In particular, the codegree is not less than the order, and equality is possible 
only if X* is a hypersurface in its linear span {X*). 

Sketch of proof. The idea is to produce points of high multiplicity in the dual 
variety X*. For a point a € X* we denote by multa X* the multiplicity of X* 
at a. If yl is a general (def X + l)-dimensional linear subspace of P^* passing 
through the point a, then A meets X* at a and d* — multa X* other points. 
Furthermore, if [/ is a small neighborhood of a in X* and A' is a general 
(def X + 1 (-dimensional subspace of P'^* sufficiently close to A, then N meets 
[/ in multa X* nonsingular points. 

The multiplicity defines a stratification of the dual variety. To wit, put 



X^ = {aeX* \ multa X* > k}, 



and let 



Then 



km = maxjfc I Xf. yf 0}. 
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X* = X* D X* D • • • D Xl^. 

To give a lower bound for d* it suffices to bound the number km from 
below. In fact, it is easy to prove the following 

Proposition 2.8. If X is not a cone, then d* > km + def X + 1. 

Proof. If def X = 0, then there is nothing to prove. Suppose that def X > 0, 
and let a G X^^ be a general point. Let w : P^* — + pw-i* projection 

with center at a, and let X*' = vj{X*). Since X is nondegenerate, X* is 
not a cone, and so dimX*^ = dimX* and degX*^ = degX* — multo, X* = 
d* — km- Moreover, codimpiv-i. X*' = codimpiv. X* — 1 = defX. Since, by 
our assumption, X* is nondegenerate, X*' has the same property, and so 
deg X*' > def X + 1 (cf. Theorem 3.4, (i) below). Thus d* — km ^ def X + 1 
and we are done. □ 

To give a bound for km, we consider the corank filtration (2.4.1) introduced 
in Definition 2.5. 

Proposition 2.9. For each natural number k, k < ordX one has (X^)* C X^. 

Sketch of proof. To prove the claim one can argue by induction. Let {x \, . . . , Xk) 
G X X • • • X X be a general collection of k points of X, let Vxi = {o; | 

k 

La D Tx,xi\ C X*, i = l,...,fc (we recall that La denotes the hyper- 
plane corresponding to a), and let ak G Vxi H • • • n Vx,,. By the Terracini 
lemma, it suffices to show that multaj, X* > k. Suppose that, for a gene- 
ral point Ofc-i G Vxi n •• • n Vxk-i, in ^ neighborhood of ak we already 
know that multQj,_j X* > k — 1. Then, joining ak-i with a general point 
ot G Vxk close to ak, adding defX general points of P^*, taking the li- 
near span of these def X -|- 2 points (which, since X is nondegenerate, meets 
X* in finitely many points), and passing to a limit, one can show that 
multo,;. X* > multo,fc_i X* -|- multo, X* > k. □ 

Corollary 2.10. km > ord X — 1 . 

Theorem 2.7 immediately follows from Proposition 2.8 and Corollary 2.10. 

□ 



Remarks 2.11. (i) Arguing as in the proof of Proposition 2.9, one can show 
that, for 1 < z < fc < ordX and an arbitrary point a G (X*)*, one has 

multo(X*)* > fc-z-kl. (2.11.1) 



This is an analogue of (1.7.2). 

(ii) In view of Proposition 1.8, from Theorem 2.7 it follows that 



d* > 



N — jodef X 



+ 1 > 



N+1 

n+1 



n -I- 1 



( 2 . 11 . 2 ) 
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Furthermore, if N' = N—def X, C P^ is a general linear subspace and 
X' = P^ nX, so that n' = dim X' = n— def X, X'* is a general projection 
of X* to P^ * (cf. Proposition 2.4) and codegX' = codegX = d*, then 
the same argument shows that 

+ 1 

ordX'>— (2.11.3) 
“ n' + 1 ^ ^ 

Thus from Theorem 2.7 it follows that 

N' + I N + l 

d* = codegX > (2.11.4) 

n' + 1 n + 1 

Suppose further that 

{X'*f X'* (2.11.5) 

for some I such that 

X'i*^0. (2.11.6) 

Then one can choose points a,j3 € X[* so that the line {a,(}) is not 
contained in X'* , from which it follows that 



d* > 21. (2.11.7) 

By Proposition 1.8, < ord A"'— 1, and thus there exists an I > 

satisfying (2.11.6) If (2.11.5) holds for such an I, then (2.11.7) yields 



d* >2l> 2- 



N' -n' 



n' + 1 



> 2 - 



N — n 
n + 1 ’ 



( 2 . 11 . 8 ) 



which is almost twice better than (2.11.3). 

Inequalities (2.11.4) and (2.11.8) give lower bounds for the codegree in 
terms of dimension and codimension. We will obtain a still better (uni- 
versal and sharp) bound of this type in Section 4 (cf. Theorem 4.7). 

(iii) Our proof of Theorem 2.7 is based on producing points of high multiplicity 
in the dual variety. More precisely, in Proposition 2.9 we showed that the 
points in X* corresponding to /c-tangent hyperplanes have multiplicity at 
least k. There is another natural way to produce highly singular points 
in X* . To wit, if the hyperplane section of X corresponding to a point 
a e X* has only isolated singular points xi, ... ,xi € Sm A", then it is easy 
to show that a € X* \ X*_^^, where ^ Hi and Hi is the Milnor 

number of Xi. In fact, since the singularities are isolated, in this case X* is 
a hypersurface, and if yl is a general line passing through a and A' is a line 
sufficiently close to A, then, in a small neighborhood of a, A' meets X* in 
multax* nonsingular points corresponding to hyperplane sections having 
a unique nondegenerate quadratic singularity. Now our claim follows from 
the definition of Milnor number as the number of ordinary quadratic points 
for a small deformation of function (cf. [Dim] for a less direct proof). 
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This method allows to show that d* is quite high (in particular, higher 
then all the bounds that we discuss here) if all (or at least sufficiently 
many, in a certain sense) hyperplane sections of X have only isolated 
singularities (which, for example, is the case when X is a nonsingular 
complete intersection) . However, we cannot assume this, and indeed in our 
examples “on the boundary” (cf. Examples 2.6, 1),5), 6) (for r even) and 
Theorem 3.5 (iii), II.4) all singularities of hyperplane sections are either 
nondegenerate quadratic or nonisolated (cf. Condition (*) in [Zl]). So, 
we will not further discuss this method here. 

Conjectured Theorem 2.12. Let X" C P'^ be a nondegenerate variety. 
Then the following conditions are equivalent: 

(i) d* = codegX = ordX; 

(ii) X is (a cone over) one of the following varieties: 

1. X is a quadric, N = n + 1, d* = 2; 

II. X is a Scorza variety (cf. [Z2, Chapter VI]). More precisely, in this 
case there are the following possibilities: 

11. 1. X = U 2 (P") is a Veronese variety, N = 

11. 2. V = P“ X P“, a > 2 is a Segre variety, n = 2a, N = a{a + 2) = 

d* = a+l; 

11. 3. X = G{2m + 1,1) is the Grassmann variety of lines in p2™+i^ 

m > 2, n = Am, N = m{2m + 3) = , d* = m + I; 

11. 4. X = E is the variety corresponding to the orbit of highest weight 

vector in the lowest dimensional nontrivial representation of the 
group of type Eq, n = 16, = 26, d* =3. 

Idea of proof . The implication (ii)=^(i) is immediate (cf., e.g., [Z2, Chap- 
ter VI]). Thus we only need to show that (i)=^(ii). 

The case ordV = 2 being obvious, one can argue by induction on ordV. 
Given a variety X C P^ with d* = ordV, we consider its projection X' C 
pAf-n-i (embedded) tangent space Tx,x at a general point x G X. 

Then ordV' = ordV — 1, and it can be shown that codegV' = codeg V — 1. 
Thus X' also satisfies the conditions of the theorem, and, reducing the order, 
we finally arrive at the case ordV = 3, which can be dealt with directly 
(for smooth varieties, cf. Theorem 3.5, (iii) ). Then a close analysis allows to 
reconstruct X. □ 

Remarks 2.13. (i) Of course, the above proof is not complete, particularly 
in the nonsmooth case. Moreover, some details have not been verified yet. 
A complete proof will hopefully be given elsewhere. 

(ii) Even without giving a complete classification of varieties satisfying (i), one 
can show that for such a variety km = ord A — 1, Xlf^ = (x°"''^^“^)* and 
= X*. Thus ordA^^ = ordA, and so Xf.^ is on the boundary 
of Theorem 1.6 for jodegree. In other words, in the extremal case the 
join determinant of Xf,^ coincides with the discriminant of A, and so 
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classification of varieties of minimal codegree is “contained” in that of 
varieties of minimal jodegree. A posteriori, is projectively isomorphic 
to X, and so X also has minimal jodegree. On the other hand, there exist 
varieties for which jodegree is minimal while codegree is far from the 
boundary; cf., e.g.. Examples 1.5,4) and 2.6,4). 

(iii) It is worthwhile to observe that all the varieties in Theorem 2.12 are 
homogeneous. More precisely, varieties II.1-II.4 are the so called Scorza 
varieties (cf. [Z2, Chapter VI]). Thus in the case II the points of the am- 
bient linear space correspond to (Hermitean) matrices over composition 
algebras (cf. [Z2, Chapter VI, Remark 5.10 and Theorem 5.11] and also 
[Ch]), and the points of the variety correspond to matrices of rank one. 
Furthermore, homogeniety is induced by multiplication of matrices. Thus 
the true meaning of Theorem 2.12 is that, in a certain sense, the varieties 
of Hermitean matrices of rank one over composition algebras are char- 
acterized by the property that their discriminant has minimal possible 
degree. 

(iv) In Theorem 2.12 we give classification of varieties of minimal codegree, i.e., 
varieties X for which codeg X = ord X . This classification “corresponds” 
to classification of varieties of minimal degree (cf. Theorem 3.4 below). 
The next step in classification of varieties of small degree is to describe 
(linearly normal) varieties whose degree is close to minimal. The difference 
Ax = deg A — codim A — 1 is called the X- genus of A. Thus, variety 
has minimal degree if and only if its A-genus vanishes. Classification of 
varieties of A-genus one (Del Pezzo varieties) is well known; much is also 
known about varieties whose A-genus is small (cf., e.g., [Fu]). Similarly, 
one can define X -genus of A by putting X x = codeg A — ord A (or 
Vx = codeg A — ord A — def A). An interesting problem is then to give 
classification of projective varieties of small V-genus. 



3 Varieties of Small Degree and Codegree 

Theorems 2.7 and 2.12 give a nice idea of what it means for a variety to have 
small codegree. However, the answer is given in terms of the notion of order 
of variety which is not very common. A similar question about varieties of 
small degree has been studied for a century and a half. To put the problem 
in a proper perspective, in this section (which is of an expository nature) we 
collect various known results on varieties of small degree and codegree. 

We start with giving sharp bounds for the codegree of nonsingular curves 
and surfaces in terms of standard invariants, such as codimension and degree. 
In the case of curves one gets the following counterpart of Theorem 1.9. 

Proposition 3.1. (i) Let C he a nondegenerate nonsingular curve of 

degree d and codegree d* . Then d* > 2d — 2 with equality holding if and 
only if C is rational. 
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(ii) Let C C P" &e an arbitrary nondegenerate curve. Then d* = codegC > 
2 codim C = 2N — 2 with equality holding if and only if C is a normal 
rational curve. 

Proof. First of all, it is clear that def (7 = 0 for an arbitrary curve C. For any 
nonsingular curve C of genus g and degree d one has 

codeg (7 = 2(g + d — 1) (3.1.1) 

(this is essentially the Riemann-Hurwitz formula; its generalization to singular 
curves is immediate, but does not yield the inequality in (i) ). 

Assertion (i) immediately follows from (3.1.1) ( (i) is trivially false without 
the assumption of smoothness; to see this, it suffices to consider the case N = 2 
and use Theorem 2.2). 

In the case of nonsingular curves, assertion (ii) follows from (i) since d> N 
for an arbitrary nondegenerate curve (7 with equality holding if and only if (7 
is a normal rational curve (this is a very special case of Theorem 3.4 below). 

If (7 C P^ is a nondegenerate, but possibly singular curve and (x,y) is 
a general pair of points of (7, then it is easy to see that the points a and [3 
on the hypersurface (7* corresponding to the osculating hyperplanes at x and 
y respectively have multiplicity at least N — 1 (cf. also Remark 2.11, (iii) ). 
From the Bertini theorem it follows that the line {a, (3) joining the points a 
and (3 in P^* is not contained in C* (in other words, the self-join of the dual 
(osculating) curve of (7 is not contained in the dual hypersurface). This proves 
the inequality d* > 2N — 2. From our argument it also follows that equality 
d* = 2N — 2 is only possible for curves without hyperosculation points, i.e., 
for rational normal curves. □ 

Lower bounds for the class can be also obtained for smooth surfaces (in 
this case the defect is always equal to zero, cf. [Zl]). 

Proposition 3.2. Let X C P^ be a nondegenerate nonsingular surface of 
degree d and codegree d* . 

(i) d* > d—1. Furthermore, d* = d—1 if and only if X is the Veronese surface 
U 2 (P^) or its isomorphic projection to P"*, and d* = codeg A = deg A = d 
if and only if X is a scroll over a curve. 

(ii) d* > N — 2. Furthermore, d* = codeg A = codim A = N — 2 if and only 
if X is the Veronese surface W 2 (P^); and d* = N — 1 if and only if X is 
either an isomorphic projection of the Veronese surface U 2 (P^) to P'^ or 
a rational normal scroll. 

Proof. Assertion (i) is proved in [Zl, Proposition 3] (cf. also [M], [Gl], [G2]). 

Assertion (ii) follows from (i) since d > N — 1 for an arbitrary nondegen- 
erate smooth surface A with equality holding if and only if A is either the 
Veronese surface U 2 (P^) C P® or a normal rational scroll (this is a special case 
of Theorem 3.4 below). □ 
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Some work has been done in the direction of classification of smooth sur- 
faces and, to a smaller degree, threefolds of small class (cf. [L], [LT], [LT2], 
[TV], but the corresponding results are based on computations involving Betti 
numbers or Chern classes and do not extend to higher dimensions. 

Furthermore, it is not even clear which values of class should be consid- 
ered “small”. In most cases, in the existing literature class is compared to 
degree, which only seems reasonable for low-dimensional varieties (anyhow, 
the bounds obtained in [Bal] are very rough). On the other hand, in [TV] the 
authors give a classification of smooth surfaces whose class does not exceed 
twenty five, which does not seem to be a “small” number. It is clear that re- 
sults of such type rely on classification of curves and surfaces and can hardly 
be generalized to higher dimensions. 

To understand the situation better and pose the problem in a reasonable 
way, it makes sense to consider a similar question for varieties of low degree. 
There are two types of results concerning such varieties, viz. classification 
theorems for varieties whose degree is absolutely low and bounds and clas- 
sification theorems for varieties whose degree is lowest possible (in terms of 
codimension) . 

An example of the first type is given by the following 

Theorem 3.3. Let A" C he a nondegenerate variety of degree d. Then 

(i) d = 1 if and only if X = P^; 

(ii) d = 2 if and only if X is a quadric hypersurface in P'^; 

(iii) d = 3 if and only if X is one of the following varieties: 

1. X is a cubic hypersurface in P^; 

II. A = P^ X P^ zs a Segre variety, n = dim A = 3, A = 5; 

II j. A = Fi is a nonsingular hyperplane section of the variety II, i.e., 
n = dim A = 2, A = 4, and X is the scroll to which P^ is mapped by 
the linear system of conics passing through a point; 

II 2 . A = f 3 (P^) is a nonsingular hyperplane section of the variety II), i.e., 
n = dim A = I, A = 3, and X is a twisted cubic curve; 

II". X is a cone over one of the varieties II, II), II) (in this case n = dim A 
and A = n -|- 2 can be arbitrarily large) . 

It should be noted that, apart from hypersurfaces and cones, there exists only 
a finite number of varieties of degree three. 

Proof, (i) and (ii) are obvious, and (iii) is proved in [X.X.X]. □ 

Swinnerton-Dyer [S-D] obtained a similar classification for varieties of de- 
gree four (apart from complete intersections, all such varieties are obtained 
from the Segre variety P^ x P^ C P^ and the Veronese surface V 2 (P^) C P^ 
by projecting, taking linear sections, and forming cones). Singularities create 
additional difficulties for higher degrees, but lonescu [lol], [Io2] gave a classi- 
fication of all nonsingular varieties up to degree eight. 
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Clearly, one cannot hope to proceed much further in this way, and it is 
necessary to specify which degrees should be considered “low”. To this end, 
there is a well known classical theorem dating back to Del Pezzo and Bertini. 

Theorem 3.4. Let X" C P'^ be a nondegenerate variety of degree d. Then 
{i) d> N — n + 1; 

(ii) If d = N — n + 1, then there are the following possibilities: 

1. X = F^, N = n, d=l; 

II. X is a quadric hypersurface, N = n + 1, d = 2; 

III. X = U 2 (P^) C P® is a Veronese surface, n = 2, N = 5, d = 4; 

IV. V = P^ X c p2"-i ig Q Segre variety, N = 2n — 1, d = n; 

IV' X is a linear section of IV (the hyperplane sections of I and II have 
the same type as the original varieties, and the irreducible hyperplane 
sections of III are also linear sections of P^ x P^). It should be noted 
that varieties of this type are scrolls (cf. [E-H]; in particular, if n = 1, 
then V is a rational normal curve); 

III"-IV" X is a cone over III or over one of the varieties described in IV and 
IV' (cones over I and II are of the same type as the original varieties) . 

Proof Cf. [E-H]. □ 

A next step is to classify nondegenerate varieties A” C P^ for which the 
difference Ax = d — {N — n -|- 1) is small (if X is linearly normal, then Ax is 
called the A-genus of X; cf. Remark 2.13, (iv) ). Much is known about classi- 
fication of varieties with small A-genus and a related problem of classification 
of varieties of small sectional genus (cf., e.g., [Fu]); we will not go into details 
here. 

There is an analogue of Theorem 3.3 for codegree. 

Theorem 3.5. Let A" C P^ be a nondegenerate variety of codegree d* . Then 

(i) d* = 1 if and only if X = P^; 

(ii) d* =2 if and only if X is a quadric hypersurface in P^ (furthermore, 
def A is the dimension of singular locus (vertex) of A); 

(iii) If X is smooth, then d* = 3 if and only if X is one of the following 
varieties: 

I. A = pi X P2 c P® is a Segre variety. In this case n = 3, def A = 1, 
and X* is isomorphic to A; 

I' A = Fi C P'1 zs a nonsingular hyperplane section of the Segre variety 
from I, and X* is the projection of the dual Segre variety from the 
point corresponding to the hyperplane; 

II. X is a Severi variety (cf. [Z2, Chapter IV]). More precisely, in this 
case there are the following possibilities: 

II.l. A = U2(P^) C P® is a Veronese surface, and X* is projectively 
isomorphic to X^ (cf. Examples 1.5,5) and 2.6,5)); 
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11.2. X = X C P® zs a Segre fourfold, and X* is projectively 
isomorphic to (cf. Examples 1.5,1) and 2.6,1)); 

11. 3. X = G(5, 1) C P^^ is an eight- dimensional Grassmann variety of 
lines in P®, and X* is projectively isomorphic to X'^ (cf. Exam- 
ples 1.5,6) and 2.6,6)); 

11. 4. X = E C P^® corresponds to the orbit of highest weight vector of 
the lowest dimensional nontrivial representation of the group of 
type Eq, dimX = 16, and X* is projectively isomorphic to X'^; 

II'. X is an isomorphic projection of one of the Severi varieties E" C P“ 2 "+^ 
from II to P“+i, n = 2®, 1 < z < 4, and X* is the intersection of 
the corresponding Y* with the hyperplane corresponding to the center of 
projection (as in II, here we obtain four cases Il'.l-ir.4). 

Proof, (i) and (ii) are almost obvious (they also follow from Theorem 2.2, 
Proposition 2.4 and Theorem 3.3 (i), (ii) ), and (iii) is proved in [Z2, Chap- 
ter IV, §5, Theorem 5.2]. □ 

Remark 3.6. Comparing Theorems 3.3 (iii) and 3.5 (iii), one observes that 
classification of varieties of codegree three is already much harder than that 
of varieties of degree three and that there exist varieties of codegree three ha- 
ving large codimension (while the codimension of varieties of degree three is 
at most two) . It is likely that one can classify all smooth varieties of codegree 
four. It is interesting that, unlike varieties of low degree, smooth varieties of 
low codegree tend to be homogeneous. They also have nice geometric pro- 
perties. Thus, the “main series” II in Theorem 3.5 (iii) is formed by Severi 
varieties which are defined as varieties of lowest codimension that can be iso- 
morphically projected (i.e., they do not have apparent double points) and the 
“main series” of varieties of codegree four is conjecturally formed by the ho- 
mogeneous Legendrean varieties which, incidentally, have one apparent double 
point (i.e., their projection from a general point acquires only one singularity; 
cf. [Hw], [CMR], [LM], [Mu]). 

In what follows we address the problem of finding a sharp lower bound for 
the codegree in terms of dimension and codimension, i.e., proving an analogue 
of Theorem 3.4 (i) and describing the varieties on the boundary, i.e., proving 
an analogue of Theorem 3.4 (ii). 



4 Jacobian Systems and Hessian Matrices 

Let X C P^, dimX = rz be a nondegenerate variety, and let d* = codegX. 
Applying Proposition 2.4 and Theorem 2.2, one can replace X by its generic 
linear section X' = P^ n X such that N' = N — def A, n' = dim A' = 
n— def A, def A' = 0, and A'* is the projection of A* from the linear subspace 
±pw f- pAT* hyperplanes passing through P^ . It is clear that codeg A' = 
codeg X = d* and the dual variety A'* is a hypersurface of degree d* in P-^ * 
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defined by vanishing of a form F of degree d* N' + 1 = N — def X + 1 
variables xq, , xn'. 

Let = Jf be the Jacobian (or polar) linear system on * spanned by 
the partial derivatives i = 0 , . . . , N\ and let (j) = 4>j : P^ * — + P^ be 
the corresponding rational map. By Theorem 2.2, the GauB map 7 = 
associating to a smooth point a G X'* the point in P^ corresponding to the 
tangent hyperplane Tx'*,a maps X'* to X' . Thus one gets a rational map 
7 = '. X'* --■* X', and n' = n — def Jf is equal to the rank of the 

differential da 7 at a general point a G X'*. Since 7 is defined by the partial 
derivatives of F, it is not surprising that, at a smooth point a G X'*, the rank 
n' of the differential d^y can be expressed in terms of the Hessian matrix 

We use the following general 

Definition 4.1. Let M be a matrix over an integral ring A, and let a C H 
be an ideal. We say that M has rank r modulo a and write rku M = r li all 
minors of M of order larger than r are contained in a, but there exists a minor 
of order r not contained in a. If a = (a) is a principal ideal, then we simply 
say that M has rank r modulo a and write rk^ M = r. 

Thus rke M = 0 for every invertible element e G A, rko M = rk M is the 
usual rank, and 0 < rk„ M < ikM for an arbitrary ideal a G A. 

It turns out that the rank of Hessian matrix modulo F determines the 
rank of the differential day at a general point a G X'* , which is equal to n' . 

Proposition 4.2. In the above notations, rk^? H = n' + 2. 

Proof. This can be verified by an easy albeit tedious computation (cf. [S, 
Theorem 2]). 

For a more direct geometric proof, we observe that, for a point f G P^ *, 
the Hessian matrix is the matrix of the (projective) differ- 

ential djt/) : P'^ * — * P^ . Since, for a general point a G X'*, 

rkF F = (X' + 1) — dimKerda(f (4.2.1) 

and 

dimKerday = def X'* = N' — n' — 1 = N — n — 1, (4.2.2) 

to prove the proposition it suffices to verify that for a € Sm Jf'* one has 

KerdQ,(/> = Kerday. (4.2.3) 

Suppose to the contrary that 

KerdQ,(/> 2 Kerday. (4.2.4) 



Then 
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Imdo,(/) = ImdQ7. (4.2.5) 

In particular, if = {§§^{ 0 :), . . . , (q)) and D is the complex conjugate 

vector, then there exists a vector v such that 

z/* . V = 0, H^-v = Ha-v (4.2.6) 

(here and in what follows v = is a column vector and v* = v* ix(^+i) 

is a row vector). Denoting a vector corresponding to the point a by the same 
letter and recalling that is a symmetric matrix, one sees that (4.2.6) yields 
the following chain of equalities: 

{Ha -aY -v = (a* -Ha)-v = a* ■ {Ha • v) 

= a* ■ {Ha ■ v) = (a* ■Ha)-v= {Ha ■ aY ■ v. 

To complete the proof, we recall that, by Euler’s formula, 

Ha ■ a = {d* — l)iy, 

so that, in view of (4.2.6) and (4.2.7), 

0={d* - l)iy* ■ V = {Ha ■ aY ■ V = {Ha -aY ■v = {d* - l)v* ■ v. 

But from (4.2.9) it follows that v = Q, which is only possible if a G SingX'*, 

contrary to the assumption that a G X'* is smooth. □ 

We now use the following result which generalizes the obvious fact that if 
all elements of a square matrix M of order m are multiples of p, then det M 
is a multiple of p™ . 

Proposition 4.3. Let M he a matrix over an integral ring A, let p C A he 
a prime ideal, and let k he a natural number. Then rkpic M < rkp M + k — 1. 

In particular, if M is a square matrix of order m, then, for each prime 
ideal p C A, det M G ^ , where corkp M = m — rkp M is the corank of 

M modulo p. 

Proof. By an easy induction argument, it suffices to consider the case when 
M is a square matrix of order m and to show that 

i^p(detM) > min jzp(det M^) + 1, (4.3.1) 



(4.2.7) 

(4.2.8) 

(4.2.9) 



where, for an element a G A, iyp{a) = max {fc | a G p^} and My is the (m— 1) x 
(m— l)-matrix obtained from M by removing the i-th row and the j-th column. 
To this end, consider the matrix adj M for which (adj M)y = (— 1 )*M Mji. 
It is well known and easy to check that 

M ■ adj M = det M ■ Im, 



(4.3.2) 
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where Im is the identity matrix of order m (in standard courses of linear 
algebra it is shown that if A is a field and det M ^ 0, then M is invertible 
and M~^ = (det M)~^ ■ adj M). If det M = 0, then (4.3.1) is clear; otherwise, 
taking determinants of both sides of (4.3.2), we see that 

det (adj M) = (det M)™-^ (4.3.3) 

and so 

m- min t'p(det M^^) < :^p(det (adj M)) = (m — 1) • J^p(det M). (4.3.4) 

Thus 

TTl 

Vp{detM)> -• min Vp{det Mij) > min r'p(detM^), (4.3.5) 



which implies (4.3.1). □ 

If the ring A is notherian, then, by Krull’s theorem, fj P* = 

k 

numbers t'p(a) are finite for each element a G A, a ^ 0. However, we do not 
need this fact here. 

Applying Proposition 4.3 to the Hessian matrix H = 

N' and using Proposition 4.2, one gets the following 

Corollary 4.4. detH. 

Since all the entries of H have degree d* — 2, one has deg det i? = {N' + 
l)((i* — 2). On the other hand, degF^ = d*{N' — n' — 1), and so 

Corollary 4.4 yields the following 



Corollary 4.5. Suppose that h = detH ^ 0. Then 



codeg X = d* >2 ■ 



N' + 1 
n' + 2 



= 2 ■ 



iV-def A + 1 ^ 2 iV+ 1 
n — def A + 2 ~ n + 2 ' 



Corollary 4.5 gives the desired lower bound for codegree in terms of di- 
mension and codimension. Clearly, unless A is a quadratic cone, this bound 
can be sharp only if def A = 0, i.e.. A* is a hypersurface. Furthermore, 
Examples 2.6, 1), 5) and 6) (for r even) and Theorem 3.5 (iii), H.4 show that 
the bound given in Corollary 4.5 is indeed sharp. 

The catch is that we do not know how to tell whether or not the determi- 
nant h = hp of the matrix H (called the hessian of F) vanishes identically 
for a given form F . The simplest example of this phenomenon is when, after 
a linear change of coordinates, the form F depends on fewer than N' + 1 
variables (cf. [HI, Lehrsatz 2]). Geometrically, this means that A'* is a cone, 
and therefore the variety A' is degenerate. But then A is also degenerate. 
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contrary to our assumptions. Thus in our setup F always depends on all the 
variables. 

Hesse claimed that the converse is also true, i.e., in our language, hp = 0 
if and only if X' is degenerate (cf. [HI, Lehrsatz 3]). Moreover, his paper [H2] 
written eight years later is, in his own words, devoted to “giving a stronger 
foundation to this result”. However, as GauB put it, “unlike with lawyers 
for whom two half proofs equal a whole one, with mathematicians half proof 
equals zero, and real proof should eliminate even a shadow of doubt” . This was 
not the case here, and, twenty five years after the publication of [HI], Gordan 
and Nother [GN] found that Hesse’s claim was wrong. To wit, they did not 
produce an explicit example of form with vanishing hessian, but rather verified 
the existence of solutions of certain systems of partial differential equations 
yielding such forms. In particular, they checked that, while Hesse’s claim is 
true for N' = 2 and N' = 3, it already fails for = 4 (i.e., for quinary 
forms) . 

Even though constructing examples of forms with vanishing hessian might 
not be evident from the point of view of differential equations, it is easy from 
geometric viewpoint. From the above it is clear that h = hp = 0 if and only 
if the Jacobian map 4> = 4>j : P'^ fails to be surjective. 

Example 4.6. Let = P^ x P^ C P® be the Segre variety considered in 
Theorem 3.5 (iii),I, so that X* ~ X and deg AT = degX* = 3, and let X' = 
Fi C P'^ be a nonsingular hyperplane section of X. Then X'* is the projection 
of X* from the point corresponding to the hyperplane (the center of projection 
is not contained in X*; cf. Theorem 3.5(iii),P). I claim that the hessian 
h= hp oi the cubic form F defining X'* is identically equal to zero (this was 
first discovered by Perazzo [P] who used the theory of polars) . 

In fact, it is clear that the entry locus of the center of projection in P^* 
is a nonsingular quadric surface. The restriction of the projection on this 
quadric is a double covering of the image, a plane H C P"^*, ramified along 
a nonsingular conic G C H. Thus Sing AT'* = H and X'* is swept out by 
a family of planes P^, a S G such that P^ n H = Tc,a, i-e., the planes of the 
family meet H along the tangent lines to the conic. Furthermore, the pencil of 
hyperplanes passing through a fixed plane P^ is parameterized by a fibre fa of 
the scroll AT' = Fi, the corresponding hyperplane sections of X'* are a union 
of P^ and a nonsingular quadric, and these quadrics meet P^ along a union 
of Tc,a and lines from the pencil defined by the point a G P^ n G. Finally, 
the hyperplane sections of X'* corresponding to the points of the exceptional 
section s of the scroll X' = Fi, i.e., those cut out by the hyperplanes in P"** 
passing through H, have the form P^ + 2H. 

In this example J isd,, linear system of quadrics with base locus H. We need 
to check that dim</)(P'^*) < 4, i.e., the fibres of </> are positive-dimensional. To 
this end, we observe that, by the above, a general point ^ G P"** is contained 
in a unique hyperplane of the form P^ = (P^,H). Restricted to P^, the linear 
system J has fixed component H. Thus ^|p 3 is a linear projection, and to prove 
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our claim it suffices to recall that 7 and (f>{X'*) = X' . In particular, 

(j) blows down the plane to a line, hence it maps P^ to a plane, and the 
fibres of (p are lines. Furthermore, Z = (/)(P‘^*) C P'^ is a quadratic cone with 
vertex at the minimal section s of the scroll X' = Fi, and Z = T{s,X') = 
U Tx',x = I • X' is the join of s with X' . □ 

X^S 

Some work has been done towards better understanding the condition of 
vanishing of the hessian (cf. [P], [Fr], [C], [II], [PW]), but it does not seem to 
be helpful in dealing with our problem. 

In what follows we show that Corollary 4.5 is true for an arbitrary nonde- 
generate variety X, even though the corresponding hessian may vanish. 



Theorem 4.7. In the above notations, 



N' + 1 

codeg X = d* >2 ■ — — — = 2 
n' + 2 



N -deiX + 1 N+1 



n — def X + 2 



n -\~ 2 



In view of Proposition 4.2, Theorem 4.7 is equivalent to the following 
elementary statement not involving any algebraic geometry. 



Theorem 4.8. Let F be an irreducible form of degree d in m variables which 
cannot be transformed into a form of fewer variables by a linear change of 

I < i,j < m be its Hessian matrix. 



coordinates, and let H = 

Then rk^ i? > — ^ . 

d 



dxidx. 



Before proceeding with the proof of Theorem 4.7, we need to study the 
rational map 4> = 4>j : P^ * — ■>■ P^ in more detail. From the Euler formula 
it follows that p is regular outside of S = SingX'*, and it is clear that 
Z = C P^' is an irreducible variety. 

Proposition 4.9. (i) Z D X' , r = dimZ = rkH^ — 1, where f € P^ * is 
a general point, and n' + 1 < r < N' . 

(ii) Let z € Z be a general point, and let Tz = p~'^{z) be the corresponding 
fibre. Then Tz is an {N' — r)- dimensional linear subspace passing through 
the {N' — r — 1)- dimensional linear subspace '^Tz^z- 

(iii) Z* C S. Furthermore, if z G Z is a general point, then Tz H X'* = 
FzG\X = FzFZ* = ^Tz.z- 



Proof, (i) Since the ground field has characteristic zero, p = pj is generically 
smooth (or submersive), i.e., r = rkd^(() for a general point ^ G P^ *. On the 
other hand, it is clear that rkd^(() = rkiJ^ — 1, which proves the first assertion 
of (i). 

The second assertion easily follows from the observation that rkd^</> is 
lower semicontinuous as a function of f and, by virtue of (4.2.1) and (4.2.3), 
rkdap = rkdo .7 + 1 for a general point a G X'*. 
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(ii) Let ^ G !Fz \ S, and let be the Hessian matrix at the point 
Since the matrix is symmetric and = z, one sees that, in the obvious 
notations, 

= (^,P(KerH^)> = (^, ^P(lmiJ^)) D (^^Tz,z). (4.9.1) 

For ^ ^ S, the Euler formula (4.2.8) shows that 

C^^P(ImiL^). (4.9.2) 

If the fibre J^z is reduced, then, since the ground field has characteristic zero, 
from (4.9.1) it follows that !Fz is a cone with vertex ^Tz^z- If, moreover, 
z G SmZ and J^z is equidimensional of dimension N' — r, then (4.9.1) shows 
that iFj is a union of {N' — r)-dimensional linear subspaces of P'^ * meeting 
along -^Tz,z- 

Considering the graph of 4> obtained, at a general point 2 ; G Z = (Z*)*, 
by blowing up Z (so that z is replaced by the linear subspace '^Tz^z along 
which the hyperplane '^z is tangent to Z*) and restricting the projection 
corresponding to 4> on the inverse image of Z, we see that, for a general point 
G Z*, the fibre has only one component. 

(iii) To prove that Z* C S it suffices to verify that, for a general point 
z G Z, '^Tz^z C S. Suppose that this is not so, and let ^ € ~^Tz^z \ Z. 
By (ii), '^Tz^z C Tz and thus = z. But then '^Tz^z C ■*~P(ImiL^) and 
from (4.9.2) it follows that, contrary to our assumption, ^ ^ "^7z,z. The 
resulting contradiction shows that Z* C S. 

If z ^ X', then, clearly, Tz dX'* = TzdX. From the first assertion of (iii) 
it follows that ^Tz,z GL TzdZ* GLTzdX. If, furthermore, z is general in the 
sense of (ii), then from (4.9.1) and (ii) it follows that TzdX = ^Tz,z- □ 

Describing forms with vanishing hessian and the dual varieties of the cor- 
responding hypersurfaces is an interesting geometric problem which will be 
dealt with elsewhere. In particular, one can obtain natural proofs and far go- 
ing generalizations of the relevant results in [GN], [Fr], [C] and [II]. However 
in the present paper we only need the properties listed in Proposition 4.9. 

We proceed with showing that if the hessian h = hp vanishes identically 
on *, then we get an even better bound for d* = degF. To this end, we 
first recall some useful classical notions. 

Let G{m,l) denote the Grassmann variety of ^dimensional linear sub- 
spaces in P™, let U be the universal bundle over G{m, /), and let p :U ^ P™ 
and q : U ^ G{m, 1) denote the natural projections. For a subvariety 
0 C G{m, 1), we denote by his the restriction of on 0 and put ps = 




Definition 4.10. An irreducible subvariety 0 C G{m, 1) is called congruence 
if dim Q = m — 1. 

The number of points in a general fibre of the map ps '■ his IF”” (equal 
to degpe) is called the order of 0 (usually there is no danger of confusing 
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this notion with the one introduced in Definition 1.3). In particular, the map 
PQ is birational if and only if 0 is a congruence of order one. 

The subvariety B C P*” of points in which pQ fails to be biholomorphic 
is called the focal or branch locus of 0. In particular, if 0 is a congruence of 
order one, then B = {w G P™ | dimp 0 ^(ii;) > 0} and codimpm i? > 1; in this 
case B is also called the jump locus of the congruence 0. 

Let 0 C G{m, 1) be a congruence of order one, and let L C P™, dimL = 
m — / be a general linear subspace. Intersection with L gives rise to a rational 
map pl ■ 0 — P™“* with fundamental locus B = B^ = 0 H L^, where 
Li = {£ G G(m, 1) I dim^ n L > 0}. 

Lemma 4.11. Either 0 is the congruence formed by all the l-dimensional 
subspaces passing through a fixed (I — \)~ dimensional linear subspace o/P™ or 
B ^ 0 and codime B = 2. 

Proof. Let L C P*” be a general (m — I + 1) -dimensional linear subspace 
containing L. Intersection with L gives rise to a rational map : 0 — ■> 
G{m — / -I- 1, 1), and it is clear that pr factors through Now it suffices to 
prove the claim for 0 = pj^{Q), which is clearly a congruence of lines of order 
one. In other words, it is enough to prove the lemma for I = 1. 

Suppose now that I = 1 and B = 0, so that V = Vq = IJ C 

i9e0 

where = Pe{gQ^{'&)). Since each is a linear subspace of codimension 
two in p™*^ IL is a hypersurface, and a general point w G F is contained 
in at least an (m — 2)-dimensional family of -^^.&s. Thus, for m > 2, the 
tangent hyperplane Ty~^ meets V along a positive-dimensional family of 
linear subspaces of dimension m — 2. Hence H is a hyperplane, and all lines 
G 0 pass through one and the same point 2 ; = V-^- G P*”. The remaining 
assertions of the lemma, as well as the cases when m <2 are now clear. □ 

Returning to our setup, we recall that hp = 0 if and only if Z C P^ . 
Suppose that this is so, let I = N' — r, and let 0 = 0 f C G{N',l) be the 
corresponding congruence of order one formed by the fibres of the Jacobian 
map (f : P^ * — ^ Z (cf. Proposition 4.9, (ii)). Cutting X'* with a general 
r-dimensional linear subspace A C P^ * and restricting (j) on A, we obtain 
a rational map A — P^ . Let w = vua ■ P^ — ^ P*" denote the projection 
with center at the {N' — r — l)-dimensional linear subspace "'“A, and put 
X” = zu(X'). Then, by Proposition 2.4, X”* = X'* n A. We denote by F' the 
restriction of F on A and by J' the Jacobian system of F'. Then J' defines 
a rational map (f>' = (pj' : A — ■» P*" and (j)' = w o (p\^. Furthermore, it is 
clear that (j)' is dominant and the hessian hp' does not vanish identically on 
A. More precisely, we have the following 

Proposition 4.12. In the above notations {hp/) > {r — n'—l){F') + EA + WA, 
where parentheses denote the divisor of form, E\ = pQ{qQ^{B)) n A is the 
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exceptional divisor of 4>' outside of X"* , Wa = (</'|^) ^{Ra), and Ra is the 
ramification divisor of the finite covering wa '■ Z ^ P’’. Furthermore, d* = 

cocleg V = codeg V' = codeg V" > + D + degEg + deg 

n +2 

Proof. The fact that the divisor {hp') contains {r — n' — 1)(T’0 proved in 

Corollary 4.4, and from the above discussion it is clear that {hp') also contains 

i?A and Wa- Computing the degrees, we get (r + l)(d* — 2) > {r — n' — l)d* + 

, TO , TTc , 2(r + 1) + degi?A + degtVA 

deg i?A + deg Wa, so that d > ^"+”2 ’ 

Proposition 4.12 shows that to give a lower bound for the codegree it 
suffices to obtain lower bounds for deg Wa and deg i^A • 

Proof of Theorem In view of Proposition 4.12, to prove Theorem 4.7 it 
suffices to show that degi^A + degWA > 2(fV' — r). The case when hp yf 0, 
i.e., Z = P^ was dealt with in Corollary 4.5; so, we may assume that r < TV'. 

We claim that under this assumption, i.e., when the hessian vanishes, one 
has a strict inequality 



degilA+degWA > 2(W-r), (4.7.1) 



which, by virtue of 4.12, yields a strict inequality 

7V+ 1 

d* > 2^-. (4.7.2) 

To prove (4.7.1) we recall that from Lemma 4.11 it follows that Sa <Z, and 
so 

degLlA>0 (4.7.3) 

(as a matter of fact, it is very easy to show that E\ is nonlinear, and so 
degE\ > 2). On the other hand, from Proposition 4.9, (i) it follows that Z is 
nondegenerate, and, applying Proposition 3.1, (ii), we conclude that 

degWA >2(fV'-r). (4.7.4) 



The inequality (4.7.1) (hence (4.7.2), hence Theorem 4.7) is an immediate 
consequence of the inequalities (4.7.3) and (4.7.4). □ 



Remarks 4.13. (i) The bounds in Theorems 2.7 and 4.7 appear to be quite 
different, and the methods used to prove these bounds are very different as 
well. However, there seems to be a connection between these bounds. To 
wit, one may conjecture that, at least for nondegenerate smooth varieties 
X C P'^ of dimension n, one always has 



7V+ 1 
n + 1 



< ordX < 2 



N+1 
n -\~ 2 



(4.13.1) 
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(we recall that the first inequality in (4.13.1) was proved in Proposi- 
tion 1.8). Thus, at least for smooth varieties, Theorem 2.7 should follow 
from Theorem 4.7. The upper bound for order in (4.13.1) can be viewed as 
a generalization of the theorem on linear normality. Indeed, if the secant 
variety S'X is a proper subvariety of or, equivalently, ordX > 3, then 
from (4.13.1) it follows that N > ^ + 2, which coincides with the bound 
for linear normality (cf. [Z2, Chapter 2, §2]). Similarly, for ordX > 4, 
(4.13.1) yields N > 2n + 3, which can be easily proven directly. 

(ii) From (4.7.2) and Corollary 4.5 it follows that if the bound in Theorem 4.7 
is sharp (i.e., d* = 2^^^) and X is not a quadratic cone, then def = 0 
and hp ^ 0 (i.e., r = N); see Conjecture 4.15 for a more precise statement. 

(iii) The lower bound in (4.7.1) can be considerably improved. To wit, as in 
the case of Wp, one can obtain a lower bound for degEp in terms of the 
codimension of Z. This yields a better lower bound for d* in the case of 
vanishing hessian. However, we do not need it here. 

(iv) The techniques of studying Jacobian maps and Hessian matrices that we 
started developing in this section can also be useful in studying other 
problems, such as classification of Jacobian (or polar) Cremona transfor- 
mations (cf. [EKP], [Dolg]) or, more generally, classification of forms F 
for which the general fibre of the Jacobian map (pjp is linear (i.e., classi- 
fication of homaloidal and subhomaloidal forms) . This topic will be dealt 
with elsewhere. 

Proposition 4.14. Let X” C P^ he a nondegenerate variety. Then the fol- 
lowing conditions are equivalent: 

(i) d* = codeg X = 

(ii) Either N = hp = 0 and X is a quadratic cone with vertex pdefx-i 

or def = 0 and hp = pN-n-i^ where F is a suitably chosen equation 

of the hypersurface X* . 

Proof. In Remark 4.13, (ii) we already observed that, unless X is a quadratic 
cone, (i) implies defX = 0 and ha yf 0, where G is an equation of X*. Thus 
from Corollary 4.4 it follows that | ha. Since degG^“"“^ = d*{N — 

n — 1) and deg ha = {N l)(d* — 2), (i) implies that degG^“"“^ = deg ha, 
and so he = c • where c G C is a nonzero constant. Hence, replacing 

Ghy F = c"^, we get hp = Thus (i)^(ii). 

Conversely, in the non-conic case from (ii) it follows that degF'^“"'“^ = 
deg hp, hence d* {N — n — 1) = (N l)(d* — 2), whence (ii)=^(i). □ 

Having obtained a bound for codegree in Theorem 4.7, it is natural to 
proceed with describing the varieties for which this bound is sharp, just as 
in Theorem 2.12 we classified the varieties on the boundary of Theorem 2.7. 
However, we have not proved classification theorem for these varieties yet. 

Conjecture 4.15. A nondegenerate variety X" C P^ satisfies the equivalent 
conditions of Proposition 4.14 if and only if X is one of the following varieties: 
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I. X is a quadric, N = n + 1, d* = 2] 

II. X is a Scorza variety (cf. [Z2, Chapter VI]). More precisely, in this case 
there are the following possibilities: 

11. 1. X = U 2 (P") is a Veronese variety, N = d* = n + 1] 

11. 2. X = P“ X P“, a > 2 is a Segre variety, n = 2a, N = a(a + 2) = 
d* = a + I; 

11. 3. X = G{2m + 1, 1) is the Grassmann variety of lines in p 2 ™+i^ m > 2, 

n = 4m, N = m{2m + 3) = d* = m + 1; 

11. 4. X = E is the variety corresponding to the orbit of highest weight 
vector in the lowest dimensional nontrivial representation of the group 
of type Eq, n = 16, N = 26, d* = 3. 

Remarks 4-16. (i) As in Conjectured Theorem 2.12, it seems reasonable to 
argue by induction. Let x € A be a general point, and let Vx C X* be the 
(IV— n— l)-dimensional linear subspace of P'^* which is the locus of tangent 
hyperplanes to X at x. It is clear that the restriction of the Jacobian linear 
system Jp on Vx is a hypersurface in Vx defined by vanishing of for 
any i = 0, . . . , N (since Vx is a fibre of the GauB map 7 : X* — + X, the 
nonvanishing partial derivatives are proportional to each other on Vx)- 
In this way one obtains a homogeneous polynomial E' = of degree 
d*' = d* - 1 on Vx = and a map (/>' : p^-«-i* pN-n-i 

defined by any row of the Hessian matrix of E restricted on Vx- 

(ii) It is worthwhile to observe that the varieties in Conjecture 4.15 are the 
same as those in Conjectured theorem 2.12, i.e., although the bounds in 
Theorem 2.7 and Theorem 4.7 are quite different, the extremal varieties 
are expected to be the same (and, in particular. Remark 2.13, (iii) should 
also apply to the varieties on the boundary of Theorem 4.7). This comes as 
no big surprise in view of Remark 4.13, (i). Assuming the bound (4.13.1), 
we observe that Conjecture 4.15 implies Theorem 2.12. 

(iii) As in Remark 2.13, (iv), we observe that, having classified varieties of 
minimal codegree, it is natural to proceed with giving classification of 
varieties of “next to minimal codegree”. However, this notion is not so 
easy to define. In particular, one should exclude projected varieties and 
varieties with positive defect. This having been said, we observe that, un- 
like the bound for minimal degree in Theorem 3.4 which is additive in 
n = dim A and N = dim (A), the bound in Theorem 4.7 is of a multi- 
plicative nature. Thus, varieties of next to minimal degree in the sense 
of Theorem 4.7 should have codegree d* = 2^^^. An example of such 
varieties is given by the homogeneous Legendrean varieties A" C p2"+i 
mentioned in Remark 3.6, in which case d* = 4. 
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